WO2015145670A1 - Device for creating user interface screen and program for creating user interface screen - Google Patents

Abstract

　A structural component display unit (231) displays, on a user interface creation screen, a structural component included in the user interface screen used by a user. A motion data acquisition unit (210) acquires, from a motion sensor that detects the motion of a creator who creates the user interface screen, motion data (201) representing the motion of the creator. An animation generation unit (251) generates, on the basis of the motion data (201), animation data (292) for moving the structural component displayed on the user interface creation screen the same way as the creator moves.

Description

User interface screen creation device and user interface screen creation program

The present invention relates to a technique for creating a user interface screen.

Patent Document 1 discloses a technique for displaying a user interface in an easy-to-understand manner when the screen size is changed. Patent Document 1 discloses using a motion sensor to detect the attitude of the information processing apparatus.
Patent Document 2 and Patent Document 3 disclose the use of a motion sensor as input means in order to improve the operability of the apparatus.
However, none of the documents discloses a method for generating a user interface screen including a moving part using a motion sensor.

JP 2013-186701 A JP 2010-086367 A JP 2012-073658 A

The object of the present invention is to enable creation of a user interface screen including components that move in the same manner as the creator's operation.

The user interface screen creation device of the present invention comprises:
A component display unit for displaying a component included in a user interface screen used by a user on a user interface creation screen for creating the user interface screen;
A motion data acquisition unit that acquires motion data representing the movement of the creator from a motion sensor that detects the movement of the creator who creates the user interface screen;
Based on the motion data acquired by the motion data acquisition unit, animation data for moving the component displayed on the user interface creation screen by the component display unit in accordance with the movement of the creator is generated. An animation generation unit.

According to the present invention, it is possible to create a user interface screen including components that move in the same manner as the creator's operation.

1 is a configuration diagram of a user interface screen creation system 100 according to Embodiment 1. FIG. 6 is a diagram illustrating an example of a user interface screen 101 according to Embodiment 1. FIG. 2 is a functional configuration diagram of a user interface screen creation device 200 according to Embodiment 1. FIG. 6 is a diagram illustrating an example of a motion management file 203 according to Embodiment 1. FIG. 6 is a flowchart of user interface screen creation processing according to the first embodiment. 6 is a diagram showing an example of a user interface creation screen 102 according to Embodiment 1. FIG. 6 is a diagram showing an example of a user interface creation screen 102 according to Embodiment 1. FIG. 6 is a diagram showing an example of a user interface creation screen 102 according to Embodiment 1. FIG. 6 is a diagram showing an example of a user interface creation screen 102 according to Embodiment 1. FIG. 2 is a hardware configuration diagram of a user interface screen creation device 200 according to Embodiment 1. FIG. FIG. 10 is a functional configuration diagram of a user interface screen creation device 200 in a second embodiment. 10 is a flowchart of preview editing processing in the second embodiment.

Embodiment 1 FIG.
A mode of creating a user interface screen including components that move in the same manner as the creator's operation will be described.

FIG. 1 is a configuration diagram of a user interface screen creation system 100 according to the first embodiment.
The configuration of the user interface screen creation system 100 according to Embodiment 1 will be described with reference to FIG. However, the configuration of the user interface screen creation system 100 may be different from that in FIG.

The user interface screen creation system 100 is a system that creates a user interface screen used by a user. The menu screen of a smartphone or tablet computer is an example of a user interface screen.
The user interface screen creation system 100 includes a motion sensor 110, an input device 120, a display device 130, and a user interface screen creation device 200. However, the user interface screen creation device 200 may include the motion sensor 110, the input device 120, and the display device 130.
UI is an abbreviation for user interface.

The motion sensor 110 detects the three-dimensional movement of the creator who creates the user interface screen. For example, the motion sensor 110 detects the movement of the creator's hand, the movement of the creator's foot, and the movement of the tool that the creator moves. LEAP motion (registered trademark) and Kinect are examples of the motion sensor 110. The motion sensor 110 may be a general-purpose sensor or a dedicated sensor for creating a user interface screen.
The input device 120 is an input device other than the motion sensor 110. A keyboard and mouse are examples of the input device 120.
The display device 130 displays a user interface creation screen for creating a user interface screen.

The user interface screen creation device 200 generates an animation that moves the components included in the user interface screen in accordance with the movement of the creator detected by the motion sensor 110.

FIG. 2 is a diagram illustrating an example of the user interface screen 101 according to the first embodiment.
The user interface screen creation apparatus 200 creates a user interface screen 101 (see FIG. 2) that includes components that move according to user operations.
The user interface screen 101 in FIG. 2 includes four plates A, B, C, and D arranged in a circle with a depth. The four plates A, B, C, and D are examples of components.
In FIG. 2 (1), when the user swipes the plate A to the right, the four plates A, B, C, and D move in a three-dimensional counterclockwise direction, and the user interface screen 101 is displayed in FIG. It will be in the state of (2).
However, the user interface screen 101 in FIG. 2 is an example of the user interface screen 101 created by the user interface screen creation device 200.

FIG. 3 is a functional configuration diagram of the user interface screen creation apparatus 200 according to the first embodiment.
A functional configuration of the user interface screen creation apparatus 200 according to Embodiment 1 will be described with reference to FIG. However, the functional configuration of the user interface screen creation apparatus 200 may be different from that shown in FIG.

The user interface screen creation device 200 includes a motion data acquisition unit 210 and an input data acquisition unit 211.
The user interface screen creation device 200 includes a user interface creation screen display unit 220, a component generation unit 230, a component display unit 231, and an operation component selection unit 240.
The user interface screen creation device 200 includes an animation detection unit 250, an animation generation unit 251, an operation assignment unit 260, and a user interface screen generation unit 270.
The user interface screen creation device 200 includes a device storage unit 290.

The motion data acquisition unit 210 acquires the motion data 201 output from the motion sensor 110. The motion data 201 is data representing the three-dimensional movement of the creator detected by the motion sensor 110. For example, the motion data 201 when the creator moves the hand includes coordinate values representing the position of the hand before the operation and coordinate values representing the position of the hand after the operation.
The input data acquisition unit 211 acquires input data 202 output from the input device 120. The input data 202 is data indicating a creator's instruction input using the input device 120.

The user interface creation screen display unit 220 displays an image representing the user interface creation screen on the display device 130.

The component generation unit 230 generates component component data 291 representing a component based on motion data 201 (also referred to as additional component selection data) or input data 202 that indicates a component. The component data 291 is image data of the component.
The component display unit 231 displays the component on the user interface creation screen based on the component data 291.

Based on the motion data 201 (also referred to as motion part selection data) or the input data 202 that indicates the component that is the object to be moved, the motion part selection unit 240 selects one or more constituent parts included in the user interface creation screen from Select the component that you want to move. Hereinafter, the component to be moved is referred to as an operation component.

The animation detection unit 250 detects a start instruction based on motion data 201 (also referred to as animation start data) or input data 202 which means a start instruction for starting generation of an animation.
The animation detection unit 250 detects an end instruction based on motion data 201 (also referred to as animation end data) or input data 202 which means an end instruction to end the generation of animation.

Based on the motion data 201 (also referred to as animation generation data) acquired from the start instruction to the end instruction, the animation generation unit 251 generates animation data 292 in which the moving part moves in accordance with the movement of the creator. The animation data 292 is moving image data including a plurality of still image data.
The animation generation unit 251 corrects the movement of the component so that the component moves smoothly when generating the animation data 292.

The operation assignment unit 260 generates operation data 293 based on the motion data 201 or the input data 202 that instructs the user's operation. The operation data 293 is data representing a user operation assigned to the operation component.
When a user operation represented by the operation data 293 is performed, the motion component included in the user interface screen moves according to the animation data 292.

The user interface screen generation unit 270 generates a user interface screen file 294 representing the user interface screen.
The user interface screen file 294 includes component data 291, animation data 292, and operation data 293 for each component.

The device storage unit 290 stores data used, generated or input / output by the user interface screen creation device 200.
For example, the device storage unit 290 stores motion data 201, input data 202, and a motion management file 203. In addition, the device storage unit 290 stores component data 291, animation data 292, operation data 293, and a user interface screen file 294.
The motion management file 203 indicates the meaning of the creator's movement in association with the type of movement of the creator for each type of movement of the creator.

FIG. 4 is a diagram showing an example of the motion management file 203 in the first embodiment.
For example, in the motion management file 203 of FIG. 4, the movement of the creator's hand means the movement of the moving part, and the movement of making the hand goo means the end of the generation of the animation.

FIG. 5 is a flowchart of user interface screen creation processing according to the first embodiment.
User interface screen creation processing in the first embodiment will be described with reference to FIG. However, the user interface screen creation process may be different from that shown in FIG.

In S110, the creator uses the input device 120 to instruct the user interface screen creation device 200 to start creating a user interface screen. The input device 120 outputs input data 202 indicating a creator's instruction. The input data acquisition unit 211 acquires input data 202.
Then, the user interface creation screen display unit 220 displays the user interface creation screen on the display device 130 in accordance with the instruction indicated by the input data 202.
After S110, the process proceeds to S120.

FIG. 6 is a diagram illustrating an example of the user interface creation screen 102 according to the first embodiment.
For example, the user interface creation screen display unit 220 displays a user interface creation screen 102 as shown in FIG.
The user interface creation screen 102 in FIG. 6 includes a menu bar 103.
The menu bar 103 includes menus for files, parts, animations, operations, and the like.
The file on the menu bar 103 is a menu related to the user interface screen file 294. When a file on the menu bar 103 is selected, the user interface creation screen 102 displays a menu for creating a new file and saving it.
The parts in the menu bar 103 are menus for adding component parts. When a part on the menu bar 103 is selected, the user interface creation screen display unit 220 displays a list of parts.
The animation in the menu bar 103 is a menu for designating the start or end of animation generation. When the animation of the menu bar 103 is selected, the user interface creation screen display unit 220 displays a menu such as start and end.
The operation of the menu bar 103 is a menu for assigning a user operation to an animation. When an operation on the menu bar 103 is selected, the user interface creation screen display unit 220 displays a list of user operations.
Data relating to the user interface creation screen 102 is stored in advance in the device storage unit 290 (not shown).
Returning to FIG. 5, the description will be continued from S120.

In S <b> 120, the creator uses the motion sensor 110 or the input device 120 to instruct the user interface screen creation device 200 about components to be included in the user interface screen.
For example, the creator uses the input device 120 to select a component from the component menu on the user interface creation screen 102. The input device 120 outputs input data 202 specifying the selected component. Then, the input data acquisition unit 211 acquires the input data 202.
For example, the creator performs a first movement that means addition of a component part and a second movement that means a component part to be added. The motion sensor 110 detects the first movement and the second movement, and outputs motion data 201 (additional component selection data) representing the first movement and the second movement. Then, the motion data acquisition unit 210 acquires the motion data 201.

The component generation unit 230 generates component data 291 representing the instructed component based on the motion data 201 or the input data 202.
For example, the component generation unit 230 generates component component data 291 representing the component indicated by the input data 202.
For example, the component generation unit 230 determines, based on the motion management file 203, whether the first movement represented by the motion data 201 means adding a component. When the first movement means the addition of a component, the component generation unit 230 identifies the type of the component that the second movement represented by the motion data 201 means based on the motion management file 203. Then, the component generation unit 230 generates component component data 291 representing the specified type of component.

The component display unit 231 displays the component on the user interface creation screen based on the component data 291.
After S120, the process proceeds to S130.

In S120 described above, the creator may specify a plurality of components.
When a plurality of component parts are specified, the component part generation unit 230 generates a plurality of component part data 291 and the component part display unit 231 displays the plurality of component parts.

FIG. 7 is a diagram illustrating an example of the user interface creation screen 102 according to the first embodiment.
For example, when a square plate is designated as the component 104, the component generation unit 230 generates component data 291 representing the square plate, and the component display unit 231 displays the square plate on the user interface creation screen 102. Display (see FIG. 7).
Returning to FIG. 5, the description will be continued from S130.

In S130, the user interface creation screen 102 displays one or more components generated in S120.
The creator uses the motion sensor 110 or the input device 120 to instruct the user interface screen creation device 200 of an operating component. An action part is a component that the creator wants to move. The creator may instruct a plurality of moving parts.
For example, the creator uses the input device 120 to indicate an operation component. The input device 120 outputs input data 202 specifying the instructed operating component. Then, the input data acquisition unit 211 acquires the input data 202.
For example, the creator performs a movement pointing at the moving part. The motion sensor 110 detects the creator's movement and outputs motion data 201 (moving part selection data) representing the creator's movement. Then, the motion data acquisition unit 210 acquires the motion data 201.

The motion part selection unit 240 selects a motion part from one or more components included in the user interface creation screen 102 based on the motion data 201 or the input data 202.
For example, the operation component selection unit 240 selects the operation component indicated by the input data 202.
For example, based on the motion management file 203, the motion component selection unit 240 determines whether the creator's movement represented by the motion data 201 means the designation of the motion component. When the movement of the creator means the designation of the moving part, the moving part selection unit 240 selects the moving part pointed by the creator based on the motion data 201.
After S130, the process proceeds to S140.

The above S130 may be omitted.
When S130 is omitted, the component generated and displayed in S120 becomes an operation component.

In S140, the creator uses the motion sensor 110 or the input device 120 to instruct the user interface screen creation device 200 to start generating an animation.
For example, the creator uses the input device 120 to select start from the animation menu on the user interface creation screen 102. The input device 120 outputs input data 202 that specifies the start of animation generation. Then, the input data acquisition unit 211 acquires the input data 202.
For example, the creator performs a movement that means the start of animation generation. The motion sensor 110 detects the creator's movement and outputs motion data 201 (animation start data) representing the creator's movement. Then, the motion data acquisition unit 210 acquires the motion data 201.

The animation detection unit 250 detects a start instruction for starting generation of an animation based on the motion data 201 or the input data 202.
For example, the animation detection unit 250 detects a start instruction based on the input data 202.
For example, the animation detection unit 250 determines, based on the motion management file 203, whether the creator's movement represented by the motion data 201 means a start instruction. When the creator's movement means a start instruction, the animation detection unit 250 detects the start instruction.
After S140, the process proceeds to S141.

In S <b> 141, the creator performs the same movement as the movement that the operation component wants to operate. The motion sensor 110 detects the creator's movement and outputs motion data 201 (animation generation data) representing the creator's movement. Then, the motion data acquisition unit 210 acquires the motion data 201.
Based on the motion data 201, the animation generation unit 251 moves the motion parts included in the user interface creation screen 102 in accordance with the movement of the creator.

The animation generation unit 251 may correct the motion of the motion component in order to smooth the motion of the motion component. The animation generation unit 251 may correct a movement related to the speed of the moving part such as rotation or acceleration.
For example, the animation generation unit 251 represents the creator's movement with a plurality of vectors, removes vectors smaller than the motion threshold from the plurality of vectors, and moves the motion component based on the remaining vectors.
After S141, the process proceeds to S142.

In the above-described S141, the creator may give an instruction other than the movement of the moving parts by the movement of the creator. For example, the creator may instruct enlargement, reduction, or deformation of the moving parts. For example, the creator may instruct to change the color of the moving part. The motion part animation generation unit 251 changes the motion part in accordance with an instruction from the creator.

The above S141 is repeated until the creator instructs the user interface screen creation apparatus 200 to end the generation of the animation. An illustration showing the repetition of S141 is omitted.

8 and 9 are diagrams illustrating an example of the user interface creation screen 102 according to the first embodiment.
For example, when it is desired to move the motion component 105 in an arc shape in the depth direction, the creator moves the finger that points to the motion component 105 in an arc shape in the depth direction (see FIG. 8).
In this case, the animation generation unit 251 moves the motion component 105 in an arc shape like the creator's finger.
Returning to FIG. 5, the description will be continued from S142.

In step S <b> 142, the creator uses the motion sensor 110 or the input device 120 to instruct the user interface screen creation device 200 to end animation generation.
For example, the creator uses the input device 120 to select end from the animation menu on the user interface creation screen 102. The input device 120 outputs input data 202 that specifies the end of animation generation. Then, the input data acquisition unit 211 acquires the input data 202.
For example, the creator performs a movement that means the end of the generation of the animation. The motion sensor 110 detects the creator's movement and outputs motion data 201 (animation end data) representing the creator's movement. Then, the motion data acquisition unit 210 acquires the motion data 201.

Based on the motion data 201 or the input data 202, the animation detection unit 250 detects an end instruction to end animation generation.
For example, the animation detection unit 250 detects an end instruction based on the input data 202.
For example, the animation detection unit 250 determines, based on the motion management file 203, whether the creator's movement represented by the motion data 201 means an end instruction. When the creator's movement means an end instruction, the animation detection unit 250 detects the end instruction.

Then, the animation generation unit 251 generates animation data 292 representing the movement of the motion component moved in S141.
After S142, the process proceeds to S150.

In S <b> 150, the creator uses the motion sensor 110 or the input device 120 to instruct the user interface screen creation device 200 to perform a user operation to be assigned to the movement of the motion component.
For example, the creator uses the input device 120 to select a user operation from the operation menu on the user interface creation screen 102. The input device 120 outputs input data 202 that specifies the operation of the selected user. Then, the input data acquisition unit 211 acquires the input data 202.
For example, the creator performs a movement that means a user operation to be assigned. The motion sensor 110 detects the motion of the creator and outputs motion data 201 representing the motion of the creator. Then, the motion data acquisition unit 210 acquires the motion data 201.

Based on the motion data 201 or the input data 202, the operation assigning unit 260 generates operation data 293 representing an instructed user operation.
For example, the operation assignment unit 260 generates operation data 293 representing the user operation specified by the input data 202.
For example, the operation assigning unit 260 identifies a user operation that means the creator's movement represented by the motion data 201 based on the motion management file 203. Then, the operation assigning unit 260 generates operation data 293 representing the specified user operation.
After S150, the process proceeds to S160.

All or part of S120 to S150 described above is repeated until the creator instructs the user interface screen creation apparatus 200 to end creation of the user interface screen 101. An illustration showing the repetition of S120 to S150 is omitted.

In step S <b> 160, the creator uses the input device 120 to instruct the user interface screen creation device 200 to end creation of the user interface screen. The input device 120 outputs input data 202 indicating a creator's instruction. The input data acquisition unit 211 acquires input data 202.
The user interface screen generation unit 270 generates a user interface screen file 294. The user interface screen file 294 includes component data 291, animation data 292, and operation data 293 for each component included in the user interface creation screen 102.
Then, the user interface creation screen display unit 220 deletes the user interface creation screen 102 from the display device 130.
After S160, the user interface screen creation process ends.

In S160 described above, the creator may instruct attribute information to be added to the user interface screen 101.
The user interface screen generation unit 270 adds attribute information to the user interface screen file 294 in accordance with the creator's instruction.
For example, when the user interface screen 101 is a screen displayed on an in-vehicle information device (for example, a car navigation system), the user interface screen generation unit 270 adds attribute information indicating running or stopped to the user interface screen file 294. To do. Further, the user interface screen generation unit 270 may add the speed of the running animation to the user interface screen file 294 as attribute information related to the running animation. As a result, in the traveling vehicle, the in-vehicle information device can display the user interface screen 101 whose animation frame advance is slower than when the vehicle is stopped.

FIG. 10 is a hardware configuration diagram of the user interface screen creation apparatus 200 according to the first embodiment.
A hardware configuration of user interface screen creation apparatus 200 according to Embodiment 1 will be described with reference to FIG. However, the hardware configuration of the user interface screen creation apparatus 200 may be different from that shown in FIG.

The user interface screen creation device 200 is a computer that includes an arithmetic device 901, an auxiliary storage device 902, a main storage device 903, a communication device 904, and an input / output device 905.
The arithmetic device 901, auxiliary storage device 902, main storage device 903, communication device 904, and input / output device 905 are connected to the bus 909.

The arithmetic device 901 is a CPU (Central Processing Unit) that executes a program.
The auxiliary storage device 902 is, for example, a ROM (Read Only Memory), a flash memory, or a hard disk device.
The main storage device 903 is, for example, a RAM (Random Access Memory).
The communication device 904 performs communication via the Internet, a LAN (local area network), a telephone line network, or other networks in a wired or wireless manner.
The input / output device 905 is, for example, a mouse, a keyboard, or a display device.

The program is stored in the auxiliary storage device 902.
For example, an operating system (OS) is stored in the auxiliary storage device 902. Further, a program for realizing the function described as “˜unit” is stored in the auxiliary storage device 902.
The program is stored in the auxiliary storage device 902, loaded into the main storage device 903, read into the arithmetic device 901, and executed by the arithmetic device 901.

“Determining”, “Determining”, “Extracting”, “Detecting”, “Settings”, “Registering”, “Selecting”, “Generating”, “To” Information, data, files, signal values or variable values indicating the results of processing such as “input”, “output of”, etc. are stored in the main storage device 903 or the auxiliary storage device 902.

According to the first embodiment, the user interface screen creation device 200 can create the user interface screen 101 in which the components move around as the creator desires based on the intuitive instruction of the creator. For example, the component moves around in a three-dimensional movement within the user interface screen.

Embodiment 2. FIG.
A mode for previewing the motion (animation) of the moving parts will be described.
Hereinafter, items not described in the first embodiment will be mainly described. Matters whose description is omitted are the same as those in the first embodiment.

The configuration of the user interface screen creation system 100 is the same as that of the first embodiment (see FIG. 1).

FIG. 11 is a functional configuration diagram of the user interface screen creation apparatus 200 according to the second embodiment.
A functional configuration of the user interface screen creation apparatus 200 according to Embodiment 2 will be described with reference to FIG. However, the functional configuration of the user interface screen creation apparatus 200 may be different from that shown in FIG.

The user interface screen creation apparatus 200 includes a preview unit 280 and a preview editing unit 281 in addition to the functions described in the first embodiment (see FIG. 3).
The preview unit 280 displays the movement of the motion part on the user interface creation screen 102 based on the motion part animation data 292 when the creator instructs to preview the motion part. For example, the preview unit 280 displays the motion of the motion component one image at a time based on a plurality of still image data included in the animation data 292. That is, the preview unit 280 can also display the motion of the motion component by frame advance.
The preview editing unit 281 edits the attribute of the action component included in the still image displayed by the preview unit 280 according to the creator's instruction, and updates the component data 291 and the still image data based on the edited content. In other words, the preview editing unit 281 edits a still image including a motion part according to an instruction from the creator. The position, size, and color of the moving parts are examples of the attributes of the moving parts.

FIG. 12 is a flowchart of preview editing processing according to the second embodiment.
The preview editing process according to the second embodiment will be described with reference to FIG. However, the preview editing process may be different from that shown in FIG.

In S <b> 210, the creator uses the motion sensor 110 or the input device 120 to instruct the user interface screen creation device 200 to preview the motion component.
For example, the creator selects an operation component using the input device 120 and selects start from the preview menu of the user interface creation screen 102. The input device 120 outputs input data 202 that specifies the start of the preview of the motion component. Then, the input data acquisition unit 211 acquires the input data 202.
For example, the creator performs a first movement that designates an action component and a second movement that indicates the start of a preview. The motion sensor 110 detects the first movement and the second movement, and outputs motion data 201 representing the first movement and the second movement. Then, the motion data acquisition unit 210 acquires the motion data 201.

The preview unit 280 selects an action component based on the motion data 201 or the input data 202. The preview unit 280 displays the motion of the motion component on the user interface creation screen 102 by frame advance based on the plurality of still image data included in the animation data 292 of the selected motion component.
For example, the preview unit 280 selects a moving part indicated by the input data 202, and displays the movement of the moving part by frame advance based on the animation data 292 of the selected moving part.
For example, the preview unit 280 selects an action component based on the first movement represented by the motion data 201, and determines whether the second movement represented by the motion data 201 means the start of the preview based on the motion management file 203. To do. When the second motion means preview, the preview unit 280 displays the motion of the motion component by frame advance based on the animation data 292 of the selected motion component.
After S210, the process proceeds to S220.

In step S <b> 220, the creator uses the motion sensor 110 or the input device 120 to instruct the user interface screen creation device 200 to temporarily stop the preview of the motion component.
For example, the creator uses the input device 120 to select primary stop from the preview menu on the user interface creation screen 102. The input device 120 outputs input data 202 designating the primary stop of the preview. Then, the input data acquisition unit 211 acquires the input data 202.
For example, the creator performs a movement that means a primary stop of the preview. The motion sensor 110 detects the motion of the creator and outputs motion data 201 representing the motion of the creator. Then, the motion data acquisition unit 210 acquires the motion data 201.

The preview unit 280 detects a preview pause instruction based on the motion data 201 or the input data 202, and pauses the preview. That is, the preview unit 280 temporarily stops the frame advance of the movement of the motion component.
For example, the preview unit 280 detects a preview primary stop instruction based on the input data 202 designating the primary stop of the preview.
For example, the preview unit 280 determines, based on the motion management file 203, whether the creator's movement represented by the motion data 201 means a primary stop of the preview. When the creator's movement means the primary stop of the preview, the preview unit 280 detects the primary stop instruction of the preview.
After S220, the process proceeds to S230.

In S230, the creator uses the motion sensor 110 or the input device 120 to instruct the editing contents to the user interface screen creation device 200.
For example, the creator uses the input device 120 to instruct editing contents. The input device 120 outputs input data 202 that specifies editing contents. Then, the input data acquisition unit 211 acquires the input data 202.
For example, the creator uses the motion sensor 110 to perform a motion that means editing content. The motion sensor 110 detects the motion of the creator and outputs motion data 201 representing the motion of the creator. Then, the motion data acquisition unit 210 acquires the motion data 201.

The preview editing unit 281 edits the attribute of the motion part based on the motion data 201 or the input data 202, and updates the component data 291 and still image data of the motion part based on the edited content.
For example, the preview editing unit 281 edits the attribute of the operation component according to the editing content specified by the input data 202, and updates the component data 291 and the still image data.
For example, based on the motion management file 203, the preview editing unit 281 specifies the editing content that means the creator's movement represented by the motion data 201. Then, the preview editing unit 281 edits the attribute of the operation component according to the specified editing content, and updates the component data 291 and the still image data.
After S230, the process proceeds to S240.

In S240, the creator instructs the user interface screen creation apparatus 200 to resume the preview, as in the case of the primary stop instruction.
The preview unit 280 resumes the preview in the same manner as the primary stop of the preview.
After S240, the preview editing process ends.

According to the second embodiment, it is possible to preview the motion of the motion component and edit the motion of the motion component previewed.

Each embodiment is an example of a form of the user interface screen creation system 100.
In other words, the user interface screen creation system 100 may not include some of the components described in the embodiments. Further, the user interface screen creation system 100 may include components that are not described in each embodiment.

The processing procedure described with reference to the flowcharts in each embodiment is an example of the processing procedure of the method and program according to each embodiment. The method and program according to each embodiment may be realized by a processing procedure partially different from the processing procedure described in each embodiment.

「" ~ "Can be read as" ~ processing "," ~ process "," ~ program "," ~ device ".

100 user interface screen creation system, 101 user interface screen, 102 user interface creation screen, 103 menu bar, 104 component parts, 105 operation parts, 110 motion sensor, 120 input device, 130 display device, 200 user interface screen creation device, 201 Motion data, 202 input data, 203 motion management file, 210 motion data acquisition unit, 211 input data acquisition unit, 220 user interface creation screen display unit, 230 component generation unit, 231 component component display unit, 240 operation component selection unit, 250 animation detection unit, 251 animation generation unit, 260 operation allocation unit, 270 user interface screen generation 280 Preview unit, 281 Preview editing unit, 290 Device storage unit, 291 Component data, 292 Animation data, 293 Operation data, 294 User interface screen file, 901 Arithmetic unit, 902 Auxiliary storage device, 903 Main storage device, 904 communication Device, 905 I / O device, 909 bus.

Claims (8)

A component display unit for displaying a component included in a user interface screen used by a user on a user interface creation screen for creating the user interface screen;
A motion data acquisition unit that acquires motion data representing the movement of the creator from a motion sensor that detects the movement of the creator who creates the user interface screen;
Based on the motion data acquired by the motion data acquisition unit, animation data for moving the component displayed on the user interface creation screen by the component display unit in accordance with the movement of the creator is generated. An apparatus for creating a user interface screen, comprising: an animation generation unit. The motion data acquisition unit includes, as the motion data, animation start data that represents a movement that causes the animation generation unit to start generating the animation data, and an animation that represents a movement that causes the animation generation unit to end the generation of the animation data. Obtaining end data and animation generation data representing a movement that causes the animation generation unit to generate the animation data;
The animation generation unit is acquired by the motion data acquisition unit after the animation start data is acquired by the motion data acquisition unit and before the animation end data is acquired by the motion data acquisition unit. The user interface screen creation device according to claim 1, wherein the animation data is generated based on the animation generation data. The motion data acquisition unit acquires, as the motion data, additional component selection data representing a movement for selecting the component from a plurality of types of components,
The user interface according to claim 1, wherein the component display unit displays the component on the user interface creation screen based on the additional component selection data acquired by the motion data acquisition unit. Screen creation device. The component display unit displays a plurality of components on the user interface creation screen,
The motion data acquisition unit acquires, as the motion data, motion component selection data representing a motion of selecting a component from the plurality of components,
The user interface according to claim 1, wherein the animation generation unit generates the animation data for moving the selected component based on the motion component selection data acquired by the motion data acquisition unit. Screen creation device. The user interface screen creation apparatus according to claim 1, wherein the animation generation unit corrects the movement of the component and generates the animation data based on the corrected movement of the component. The user interface screen creation apparatus according to claim 1, further comprising: a preview unit that displays an animation of movement of the component on the user interface creation screen based on the animation data generated by the animation generation unit. . The user interface screen creation device includes a preview editing unit,
The preview unit displays a first still image among a plurality of still images included in the animation on the user interface creation screen,
The motion data acquisition unit acquires, as the motion data, preview edit data representing a motion for editing the first still image displayed by the preview unit,
The user interface screen creation device according to claim 6, wherein the preview editing unit edits the first still image based on the preview editing data acquired by the motion data acquisition unit. A component display process for displaying a component included in a user interface screen used by a user on a user interface creation screen for creating the user interface screen;
A motion data acquisition process for acquiring motion data representing the movement of the creator from a motion sensor that detects the movement of the creator creating the user interface screen;
Based on the motion data acquired by the motion data acquisition process, animation data for moving the component displayed on the user interface creation screen by the component display process in accordance with the movement of the creator is generated. A user interface screen creation program for causing a computer to execute animation generation processing.

Images