JP2001202340A - Display device, portable information processing device, information recording medium, and electronic device - Google Patents

Abstract

(57) [Summary] [PROBLEMS] A display device, a portable information processing device, and information that are easy to operate and easily grasp the time relationship with other information when incorporating into a schedule of a plurality of types of information. To provide a recording medium and an electronic device. A display device according to the present invention displays a plurality of types of information on a display screen. A first storage unit for storing a plurality of types of information having different attributes, a plurality of attribute information for identifying types of the plurality of types of information, and a plurality of time information related to the plurality of types of information; . Further, there is provided second storage means for storing a plurality of types of icon information respectively corresponding to the plurality of attribute information and time axis display data for displaying a time axis. Further, there is provided a display means for displaying at least a time axis and icon information on a display screen.
Further, based on the attribute information, icon information corresponding to each of the attributes of the plurality of types of information is selected, and based on the time information related to the plurality of types of information, the selected icon information is converted to the corresponding time on the time axis. It is characterized by having control means for controlling the display on the display screen so as to be arranged respectively.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a display device, a portable information processing device, an information recording medium, and an electronic device.

[0002]

2. Description of the Related Art In recent years, in the field of portable equipment and the like, a so-called PDA (Personal Digital Asist) has been used as a small-sized information processing apparatus that is easily portable.
ance) are known. An information processing apparatus such as a PDA, a personal computer (PC), an electronic organizer or a word processor is provided with a schedule management function, and personal schedule management is performed using this function.

[0003] In this type of application called a schedule, schedule management is often displayed in units of days, weeks, months, and the like. For example, a monthly calendar displays four to six weeks simultaneously. A general calendar display format is adopted.

For example, as shown in FIG. 57, a plurality of date display areas 2001 on which dates are displayed are formed on a menu screen 200 on which such a calendar is displayed, and a line 2002 is synthesized on the area 2001. By displaying or coloring the display, the user recognizes where the presence or absence of the schedule or the like is on the calendar, thereby confirming the schedule. When browsing specific contents, by selecting the colored area on the calendar-displayed menu screen 2000, a window in which data such as a plan is entered opens, and the browsing of the plan is performed. Will be performed.

However, in the above-mentioned method, only a screen for searching for a schedule or the like can be displayed on the menu screen, so that it is necessary to move to a screen of another hierarchy to see other information. There were drawbacks.

That is, a calendar-type menu screen relating to a certain type is displayed, and information such as an input schedule can be browsed on the menu screen. It is necessary to change the display screen by repeating operations such as clicking on the screen.

[0007] Therefore, when one type of information is closely related to another type of information for the user, the operation of opening a screen of another level is severe. It was inconvenient to grasp the temporal relationship between this information and other types of information.

Further, it is necessary to select each menu screen for a plurality of types of information related to each other, and therefore, it is necessary to grasp the relationship between the plurality of information layers.

Therefore, it takes time to grasp the relation between a plurality of pieces of information, and the operation is time-consuming. Especially when the items are various, it takes time to change the display screen,
It took a long time to browse, and it was not functionally convenient.

Here, for example, it is conceivable to use other types of information, for example, information relating to electronic mail in combination with the scheduler.

In this case, the electronic mail viewing software and the schedule management software have different applications. For example, when the user browses the contents of a desired electronic mail using the electronic mail software, the user normally displays the contents on the main screen. After starting the application of the e-mail browsing software, the e-mail is opened and selected, and the e-mail is specifically used.

[0012] Then, when using the schedule management software, return to the main screen again, click the icon of the schedule software, start the program,
The user can close the browsing display of the e-mail or open the window of the schedule software so as to overlap the window on which the e-mail can be viewed, and input a schedule or the like.

However, in this case, since the e-mail software and the schedule management software are completely separate applications, the user can add the information about the e-mail to the schedule as it is due to various factors such as the file format. Cannot be incorporated.

[0014] Further, in the case of embedding, there is a problem that the user has to input information on the electronic mail, for example, time, communication contents, etc. into the calendar of the schedule one by one, which is troublesome.

Since the display screen of the PDA is smaller than that of a normal PC, even if the image is compressed and reduced at the same ratio, the icon display becomes smaller, and the function of what is shown is reduced. There was a problem that it was hard to understand. Further, there is a problem that it is difficult to see characters when displaying fonts. As described above, if the resolution of the display unit is changed as it is and the size of the character or font is reduced, the display image cannot be understood by the user.

If an attempt is made to display the same amount of information as that of a PC, the icon size and font size must be displayed in a small size. This is a particularly important problem in a portable computer or an electronic organizer having a small screen size. Has become. For example, in the display of Japanese, a font of 24 × 24 dots or more is easy to see, but due to restrictions on the display screen, this font size cannot be secured and kanji and the like cannot be read.

Further, for example, JP-A-1-173139, JP-A-4-173139
In a conventional device such as 168482, an explanation display for showing a detailed meaning is added to an icon or the like, which is an object in a metaphor environment, to reduce a user's memory load. However, in such a device, information such as a keyword or a symbol is added to the icon, so that it is effective for a user who can understand the added symbol or the keyword,
A user who has no prior knowledge has a load of storing a new keyword or symbol, and operation efficiency is reduced. In addition, characters and the like are difficult to see and cannot be applied to PDAs.

In such an apparatus, a user who does not have prior knowledge has a burden of storing new keywords and symbols for understanding additional information, and it is complicated to read the added explanation itself. Is reduced.

For example, it is conceivable to display an icon as disclosed in Japanese Patent Application Laid-Open No. 5-28157. In such a normal icon display mode, a user can display a plurality of functions on which a desired function is displayed. In order to select from the icons, it is inevitable to determine where the desired function is based only on the design of each icon and the function name, and to determine what the function corresponding to each icon is. For the skilled person who remembers where is located, etc., many icons are displayed in a matrix so that the desired icon can be selected quickly, but for beginners the function corresponding to each icon It takes time to understand itself, and it is difficult to remember where the icon corresponding to the desired function is located on the screen, making mistakes in selection There has been a Itoitta problems.

In particular, in the case of a PDA, the size of the display section is generally small, so that it is difficult to understand what function is to be activated by selection, and each icon is small and difficult to select.

[0021] The present invention has been made to solve the above-mentioned technical problems, and the objects thereof are as follows.
When incorporating into the schedule of multiple types of information,
An object of the present invention is to provide a display device, a portable information processing device, an information recording medium, and an electronic device which are easy to operate and can easily grasp the time relationship with other information visually.

Another object of the present invention is to provide a display device and a portable information device that can easily understand the function associated with each icon even in a small information processing device such as a portable device. An object of the present invention is to provide a processing device, an information recording medium, and an electronic device.

[0023]

According to a first aspect of the present invention, there is provided a display device, comprising: a plurality of types of information having different attributes; a plurality of attribute information for identifying types of the plurality of types of information; Multiple time information related to multiple types of information;
A first storage unit storing a plurality of types of icon information respectively corresponding to the plurality of attribute information, and a second storage unit storing time axis display data for displaying a time axis. A display means for displaying at least the time axis and the icon information on a display screen; and selecting the icon information respectively corresponding to the attributes of the plurality of types of information based on the attribute information; Control means for controlling display on the display screen such that the selected icon information is arranged at corresponding times on the time axis, based on the time information related to the information. Features.

In the first aspect of the invention, the "attribute information" is information for identifying a plurality of types of information, for example, types of e-mail files, memo files, schedule files, voice memo files, and the like. is there.
An example of the “attribute information” is, for example, an extension for identifying a file format in a file system. However, the present invention is not limited to these.

Each icon information is prepared according to these types. Further, time information is attached to each of the plurality of types of information. Thus, according to the present invention,
A plurality of types of information can be displayed on the display screen in association with the time axis. As a result, it is possible to visually confirm the attribute identification based on the difference in the display mode of the icon information and the new and old types of information based on time without taking a complicated hierarchical structure. For example, a search can be performed using time as a key without a document name, storage name, or the like.

In addition, since a plurality of types of information are displayed on the display screen at a time and each information can be browsed by one operation, a complicated hierarchical structure and a conventional window system are not required. On devices with small screens,
A user-friendly display device can be provided. Further, the user can easily and visually recognize the mutual time relationship between a plurality of types of information based on the positional relationship of each icon information.

[0027] The display device according to the second aspect of the present invention comprises:
2. The device according to claim 1, further comprising a clock unit for clocking a current time, wherein the control unit is configured to control the display of the current time on the time axis based on the current time measured by the clock unit. The display of information is changed and controlled.

According to the second aspect of the present invention, since the time axis always moves with respect to the display screen with the passage of time, icon information near the current time is always displayed on the display screen. .

The display device according to the third aspect of the present invention is
2. The method according to claim 1, wherein at least one of the plurality of pieces of time information includes transfer time information for transferring at least one of the plurality of types of information.

According to the third aspect of the present invention, the above-described icon information can be displayed at a corresponding time position on the time axis based on transfer time information transferred together with a plurality of types of information.
As a result, the above-described display screen can be formed without providing special timekeeping means or the like.

A display device according to a fourth aspect of the present invention is
2. The control device according to claim 1, wherein the second storage unit has background display data for displaying a background of a time axis display area on the display screen, and the control unit stores the time information and the time axis display data. A background screen generating unit that synthesizes the time axis on the background screen based on the background display data.

According to the present invention, the time axis display area can be displayed by the background screen generation unit. By synthesizing and displaying the icon information on the time axis display area, it is possible to visually recognize the relationship between the preceding and following time based on the positional relationship between the plurality of icon information.

The display device according to the invention described in claim 5 is
5. The image processing apparatus according to claim 4, wherein the second storage unit has background screen coloring data for coloring and displaying a background screen for displaying a background of the time axis display area as a background.
Based on the current time information and the background screen coloring data, control is performed so that the background color of each display area on the display screen divided into two at the current time is colored with different colors. It is characterized by the following.

According to the fifth aspect of the present invention, the background display color of the display screen can be changed between the future and the past, so that the current position can be expressed by a boundary between different display colors. You can see at a glance whether the elephant is past, present or future.

The display device according to the invention according to claim 6 is:
In claim 4, the icon information has a predetermined time width along the time axis, and the second storage means stores a time area corresponding to the time width of the icon information on the time axis. The image processing apparatus has time-axis coloring data to be colored and displayed, and the background screen generating unit is configured to determine, based on the time information and the time-axis coloring data, the time of the time region corresponding to the time width of the display position of the icon information. The axis is controlled so as to be colored.

According to the invention described in claim 6, by changing the color of the time axis of the area where the icon information is located, the location where the icon information is located and the location where the icon information is not located can be recognized at a glance.

The display device according to the invention according to claim 7 is:
5. The first display unit according to claim 4, further comprising an operation unit for operating the icon information on the display screen, wherein the time-axis display data displays a first hierarchy that is divided and displayed in units of time. Displaying the time axis data for hierarchy display, the second time axis data for displaying the second hierarchy that is displayed by being divided by day, and the third hierarchy that is displayed by being divided by week And a fourth hierarchical display time axis data for displaying a fourth hierarchical level which is divided and displayed on a monthly basis. Means for selectively displaying the first to fourth layers on the display screen based on information input and operated by means and the first to fourth layer display time axis data. It has a hierarchical control unit for controlling.

According to the seventh aspect of the invention, the time axis can be hierarchically displayed for each of hour, day, week, and month, and the scale of the time axis is adjusted to grasp the outline of the degree of clogging of the icon information. it can.

The display device according to the invention of claim 8 is:
8. The control unit according to claim 7, wherein the control unit expands the unit time interval on the time axis based on an operation input of the operation unit that inputs information for scaling the unit time interval in a direction along the time axis. It is characterized in that display is controlled so as to be variable so that it can be reduced.

According to the eighth aspect of the present invention, the time axis can be scale-adjusted for each of the hierarchies, so that more detailed icon information clogging can be analyzed.

The display device according to the ninth aspect of the present invention provides
10. The control unit according to claim 9, wherein the control unit expands / contracts a shaft width having a predetermined width in a direction intersecting with the time axis, in conjunction with enlargement / reduction of the time axis, based on an operation input of the operation unit. Display control is performed as described above.

According to the ninth aspect of the present invention, since the size of the icon information is variable, for example, when the time axis is reduced and displayed and the time axis is enlarged, the icon information attached to the time axis is displayed. Can be displayed in area, the degree of clogging can be easily recognized, and the scale of the time axis can be estimated based on the size of the icon information.

According to a tenth aspect of the present invention, in the display device according to the ninth aspect, the control means interlocks with the time axis based on an operation input of the operation means in conjunction with enlargement / reduction of the time axis. It is characterized in that display control is performed so that an axis width having a predetermined width in the intersecting direction is enlarged or reduced.

According to the tenth aspect, the degree and scale of the time axis can be recognized by looking at the width of the time axis.

In a display device according to an eleventh aspect of the present invention, in the display device according to the fourth aspect, the control means is provided in the time axis display area with the icon information disappearing from the display screen as time passes. Display control within the catch net area.

According to the eleventh aspect, even if the icon information moves over time, the icon information remains without disappearing from the frame of the display screen due to the catch net area. That is, usually, the icon information on the time axis moves as the time axis on the display screen moves after time passes and disappears from the display screen. However, in the present invention, for example, a catch net area is provided exclusively over the left end area indicating the past of the display screen, and icon information off the time axis is displayed there, so that necessary icon information is out of the display frame. Can be displayed without disappearing.

According to a twelfth aspect of the present invention, in the display device according to the first aspect, the plurality of types of information are electronic mail information transmitted / received via a communication unit, and an incoming call regarding the arrival time of the electronic mail information. And time information, wherein the control means displays the icon information on the display screen in the order of arrival based on the arrival time information.

According to the twelfth aspect, when the plurality of types of information are electronic mail information, the incoming data is uniquely attached to a position on the display screen corresponding to the incoming time on the time axis. . Accordingly, when the icon information is information related to the e-mail, the icon information is displayed in the order of arrival, so that the arrival times of the plurality of e-mails can be visually recognized at a glance.

When the user wants to view this information, the user specifies the icon information related to the received information by operating means or the like, and the corresponding information is displayed on the display screen.

A display device according to a thirteenth aspect of the present invention is the display device according to the first aspect, further comprising an operation means for operating the icon information on the display screen, wherein the plurality of types of information are operated and input. Input information, and input time information on which the input information is operation-input, and the control means,
And displaying the icon information on the display screen in the order of creation based on the input time information.

According to the thirteenth aspect, when the icon information is information related to the input information, the icon information is displayed in the order of the input time, so that the input time of the plurality of input information can be updated. Visually recognizable at a glance. This input information includes, for example, a memo.

According to a fourteenth aspect of the present invention, in the display device according to the thirteenth aspect, the input information has designated time information in which a user designates a scheduled execution time of the input information. Based on the designated time information,
The icon information is displayed on the display screen in order of scheduled time.

According to the fourteenth aspect, when the icon information is information related to the input information, the icon information is displayed in the order of the specified time, so that the specified time of the plurality of input information can be updated. Visually recognizable at a glance. Examples of the input information include a schedule and the like.

According to a fifteenth aspect of the present invention, a portable information processing apparatus includes the display device according to any one of the first to fourteenth aspects.

According to the fifteenth aspect of the present invention, since the portable information processing apparatus is generally formed small and light, the size of the display means is often smaller than that of an ordinary personal computer or the like. . Therefore, by applying the above-described display form to the portable information processing device, a plurality of types of information such as e-mail, schedule,
By displaying icon information indicating a schedule, a memo, a voice memo, a voice mail, and the like, the user can recognize the time at a glance based on the positional relationship between these pieces of information. Moreover, since the attributes can be distinguished and displayed on the display means only by the display form of the icon information, the adverse effects of a complicated hierarchical structure such as a combination of conventional application software can be solved, and even an unspecified number of non-experts can be used. As a result, a portable information processing device that is extremely easy to use for the user can be formed.

A portable information processing apparatus according to a sixteenth aspect of the present invention is characterized in that, in the fifteenth aspect, the portable information processing apparatus further comprises an arm mounting portion disposed on the display device and mounted on a user's arm.

According to the sixteenth aspect of the present invention, by forming the arm mounting portion, the present invention can be applied to an extremely small information device such as a timepiece.

An information recording medium according to a seventeenth aspect of the present invention is an information recording medium for storing at least information for generating a display image, wherein a plurality of types of information for identifying a plurality of types of information are provided. Attribute information, a plurality of pieces of time information related to the plurality of types of information, a plurality of types of icon information respectively corresponding to the plurality of pieces of attribute information, time axis display data for displaying a time axis, and the attribute Based on the information, select the icon information respectively corresponding to the attributes of the plurality of types of information, based on the time information related to the plurality of types of information, the selected icon information on the time axis And information for controlling display on the display screen so as to be arranged at corresponding times.

According to the seventeenth aspect of the present invention, in order to form an information recording medium for forming the above-described display screen, it is only necessary to have the above information. By forming such an information recording medium, not only the portable information processing apparatus described above, but also a general personal computer can be installed or the like via this information recording medium to form a display screen.

An electronic apparatus according to the present invention includes the information recording medium according to the present invention.

[0061] The invention according to claim 18 has the above-mentioned information recording medium. As a result, the above-described display screen can be formed even in a general electronic device.

[0062]

Embodiments of the present invention applied to a display device will be specifically described below with reference to the drawings.

[First Embodiment] (Overall Configuration of System) FIGS. 4 and 5 show a preferred example of a system to which the present invention is applied. The system of this example includes a list-type portable device 2 as one or more user terminals and a PDA as a first information processing device, and a second information processing device.
A personal computer (hereinafter referred to as “P”) that is a host computer that provides a predetermined service as an information processing apparatus of
C1) PC1). A network is configured so that the PC 1 and the portable device 2 can communicate with each other. The PC 1 is installed, for example, at home, at a company, or the like, and the portable device 2 is used by a wearer wearing it on an arm or the like.

The PC 1 is configured using a high-performance computer, as is well known, and stores therein a time measuring unit 11 for measuring time and various data, as shown in FIG. Storage unit 12 and display unit 13 for displaying data
And an operation unit 14 for operating various kinds of information displayed on the display unit 13, and another information processing device such as the portable device 2.
And a communication unit 15 for transmitting and receiving information to and from the terminal, a sound output unit 16 for outputting sound information, a sound input unit 17 for inputting sound information, and a CPU 18 for controlling these units.

Various programs such as dedicated software for operating the PC 1 itself, dedicated application software for generating the characteristic screen of the present invention, and a Web browser for downloading to the portable device 2 are stored in the storage unit 12. , And other data such as a protocol.

In particular, it is preferable that the software for generating the characteristic screen be formed separately from the storage area of the main body of the PC 1 using a dedicated PC card or the like.

(About Data Synchronization) The portable device 2
Although used independently, as shown in FIG. 4, the portable device 2 is configured to be used as a system in synchronization with the PC 1.

In order to perform the data synchronization, various methods can be considered. For example, the PC 1 and the portable device 2
Then, the data of the portable device 2 is compared with the display of the data held in the PC 1 to form a data updating unit (not shown) for instructing updating and synchronization of the data. In this case, the data updating means is preferably provided in the communication means 15 of the PC 1 and the communication means 25 of the portable device 2 in the block diagram shown in FIG.

As another data synchronization method,
When the system is started by turning on the power of the mobile device 2, the storage unit 12 of the PC 1
Is downloaded into the storage unit 22 of the mobile device 2. When it is necessary to change the data, the data in the storage unit 12 of the PC 1 is rewritten. After that, the portable device 2 is started up,
Are set to the same state based on the changed data.

Thus, when basic data input or change is performed in either the PC 1 or the portable device 2, the portable device 2 or the PC 1 is automatically updated. In this example, even if the distance between the two devices 1 and 2 is long, the two devices 1 and 2 can be synchronized without the user being conscious.

When editing the contents of the display unit 23 of the portable device 2 on the display unit 13 of the PC 1, the display unit 13 of the PC 1
The image of the portable device 2 appears on a part of the screen of FIG.
2). Therefore, by cutting out the information on the PC 1 side and pasting it in the window, a desired image can be captured on the portable device 2 side. This will be described in detail in Embodiment 5. In particular, when a PC card is incorporated in the PC 1, the display can be browsed and is effective.

In the present example system, the size of the display unit 13 on the PC 1 side is large, and the size of the display unit 23 on the portable device 2 side is large.
Is formed small. For this reason, simply performing the synchronization simply causes the display image on the PC 1 side to be compressed and displayed on the display image on the portable device 2 side. Therefore, in the present example, the display device 13 and the display unit 23 have the same image, and are configured so that the user can naturally view the two devices as the same device. ing.

That is, by forming a unique character pattern different from the character pattern formed on the PC 1 side on the portable device 2 side, the same image can be obtained.
The icons on the mobile device are displayed in a way that is easy for the user to understand. In addition, by making the character image of the background and the icon the same, a user interface that is easy for a beginner to understand visually is provided.

(Regarding Hardware Configuration of Portable Device)
4 and 6 schematically show the appearance of the portable device 2. The portable device 2 of this example is formed to be small and lightweight so that it can be worn on the wearer's arm or the like, and specifically, the arm mounting part 20 (FIG. 4) that is worn on the wearer's arm. )
And a display unit 23 as display means formed by, for example, an LCD display or the like connected to the arm mounting unit 20.
And an operation unit 24 formed on the upper, lower, left, and right sides of the display unit 23 as operation means for performing various operations on the display screen.

The operation section 24 has a slider 24A as a first operation button, a record button 24B as a second operation button, and a track point 24C as a third operation button.

More specifically, as shown in FIG.
On the right side of 3, a slider 24A as a mode selection means that slides in the direction of the arrow AB is arranged, and on the left side of the display unit 23, a recording button 24B that functions as a voice input unit is arranged. A track point (IBM trademark) 24C as a cursor operation key for moving a cursor on the display screen up, down, left and right by moving the cursor in the direction of the arrow CDEF is arranged below the display unit 23. The slider 24A is slid once or plural times in the direction of arrow AB (notify mode +
One of the communication display mode (memo mode), the schedule display mode calendar mode, and the database display mode directory mode is selected.

Further, as shown in FIG. 5, the portable device 2 has a CPU 28 for controlling the portable device 2, and an operation unit 24 and a display unit 23 are connected to its bus line. The functions of the display driving unit shown in FIGS.
This is realized by the display drive function of the PU 28 and a display interface (not shown) in the display unit 23.

The storage section 22 including the first storage means and the second storage means is connected to the bus line of the CPU 28.
As shown in FIG. 14, for example, the storage unit 22 has a control unit 22A in which a management program is stored and an actual data unit 22B in which various data are stored. still,
The details of the real data section 22B will be described later,
It is preferable to store it in M, RAM, or the like. in this case,
The ROM has a data memory for storing character data of icons, character (background image) data for the background screen of the menu screen, font data, layout position data defining layout positions of the icons on the background image, and the like. . Further, in the ROM, a program for displaying the menu of the present example, a function program defining various functions of the apparatus of the present example, and the CPU 28 are driven when the power of the portable device 2 is turned on to start up the apparatus itself. And a program memory for storing various programs such as a boot program for raising and a predetermined display program set by first to fourth display setting units to be described later. When the power of the portable device 2 is turned on, the boot program
The storage unit 12 is configured to read a Web browser, various protocols for communication, other data, and the like, and download the data into the RAM.

In the RAM, input information input to various setting screens is stored. Therefore, the first to fourth
The functions of the display setting unit are realized by the display setting function of the CPU 28 and the functions of the storage unit 22 and a memory interface (not shown) provided in the storage unit 22.

The bus line of the CPU 28 is further connected to a clock section 21, a voice input section 27, a voice output section 26 provided with a microphone (not shown), and the like.

As shown in the block diagram of FIG.
Communication means 25 for communicating with the PC 1 is connected to the bus line of the PU. The communication means 25 includes an infrared communication unit (IRDA) for performing infrared communication.
25D and a wireless communication unit 25C that performs wireless communication 25C
And a modem 25B connected to each of them and having a modem function, a telephone 25E, and a communication unit 25A including the telephone 25E itself as a serial interface and connected to the modem 25B. The communication unit 25A is connected to the CPU 28. The infrared communication unit (IRDA) 25D has an infrared transmission unit (port). The modem 25B is configured as a soft modem in which the CPU 28 receives a serial bit string. The modem 25B has an infrared interface, and the CPU 28 performs processing of the modem 25B and the communication unit 25A. For this reason, the portable device 2 can perform communication by infrared communication and send and receive e-mail.

The CPU 28 is connected to a notifying means 29B for notifying a user of information. As the notifying means 29B, for example, vibration generating means for stimulating the user with stepwise vibration or the like, odor generating means for generating a stepwise odor, tone changing means for changing the tone of the alarm stepwise, stepwise Light generating means for generating light that can be adjusted in a stepwise manner, and discharge generating means for giving a user an electric shock that can be adjusted step by step. Furthermore, CPU
To 28, a battery capacity detecting means 29A for detecting the battery capacity of the power supply means as a battery is connected.

Further, detection means (not shown) for detecting the attitude angle of the display unit with respect to the horizontal plane may be connected. In this case, the CPU determines, based on the detection result of the detection unit,
When the detection angle is within a range of a predetermined posture angle,
The power supply is turned on, and functions as a posture switch control unit that controls the power supply to be turned off when the power is out of the range of the predetermined posture angle. Thereby, the power can be turned on and off by tilting the display device itself at a predetermined angle, and when the user does not view the display screen of the display device, the power is turned off to eliminate unnecessary display operations. Power consumption can be reduced.

(Display Screen on PC Side) A feature of the present invention is that icons having a plurality of types of functions displayed on the display screen are pasted and displayed on one time axis. is there. In addition, since the display unit has a smaller screen size between the display unit of the PC and the display unit of the portable device, the maximum time axis is also smaller. Therefore, the necessary minimum icons can be displayed.

The display screen displayed on the display unit 13 is shown in FIG.
The communication display areas 30 and 40 and the schedule display area 50 can be roughly classified as shown in FIG.
(Action) and 3 of the database display area 60
Classified and displayed in layers. Further, the communication display areas 30 and 40 are provided with an area notifying area 30 for notifying information by an incoming e-mail or the like and shifting to a lower notifying mode, and a lower memo mode for browsing the contents of memos and the like. The display area can be classified into a memo area 40 for shifting. The schedule display area 50 is an area that functions as a schedule display mode and a calendar mode for displaying a user's schedule and the like. Database display area 60
Is an area for opening a lower-level directory mode and a database display mode for classifying a list of senders of an e-mail, an address book, and the like.

In this case, an empty metaphor is displayed as a background screen in the communication display area 30, a metaphor on the ground is displayed as the background screen in the schedule display area 50, and an underground metaphor is displayed as the background screen in the database display area. Metaphor is displayed.

Communication display areas 30 and 40
Has a message pigeon icon 31 having a plurality of different shapes and colors along the electric wire, a birdhouse icon 32, and a flower icon 4.
1 and a vase icon 42 are displayed.

The transfer pigeon icon 31 is displayed as a metaphor of the electronic mail, and the contents of the electronic mail can be browsed and displayed by, for example, clicking by operating the operation unit 24. When the e-mail is opened, a lower menu screen 34 as shown in FIG. 2 is displayed. This menu screen 34 is a “Recognize” (recognition) tab 33 which is a pull-down menu below the “Synfo” tab 33A in FIG.
Click B to view. In addition, other "Synchr
The "onize" tab is for performing data synchronization.

Further, the pigeon icons 31 are arranged in chronological order along the time axis along the electric wire in the order of arrival of e-mails. Furthermore, this carrier pigeon icon 31
Are assigned special functions according to their shapes and colors. For example, a black message pigeon icon 31D indicates that the contents, contents, and transmission items of the e-mail are urgent information, and a white message pigeon icon 31C indicates that the contents of the e-mail are important items.

The birdhouse icon 32 has a function of classifying and storing browsed e-mails according to their contents, and each birdhouse icon 32 stores a plurality of e-mails. In this example, the work box icon 32A for work
And the personal nest box icon 32B, the user can organize and manage a plurality of e-mails. When the number of incoming e-mails exceeds a certain numerical value, that is, when the number of message pigeon icons 31 exceeds a certain number, a function of storing e-mails in the birdhouse icon 32 may be provided.

The flower icon 41 has a function of storing information related to a memo entered manually by pen input or the like. By clicking the flower icon 41, a post-it tab 43 on which the memo is written is displayed. Displayed on the display screen. The position of the post-it tab 43 on the display screen can be freely changed by dragging the operation unit 24 or the like irrespective of each display area. Therefore, for example, when the content written in the memo is related to a schedule at a certain time, it can be pasted on a desired time axis on the schedule display area 50, and has nothing to do with time. For example, in the case of a telephone number or the like, the post-it tab 43 can be directly attached to, for example, the sky on the display screen. By clicking the post-it tab 43 again, the display mode returns to the original flower icon 41. In addition, the input of handwritten characters in the post-it tab 43 can be performed by inputting a memo in a memo window 35 as a “post-it creation menu” shown in FIG. Then, it is preferable that "post-it information is stored" and that the post-it information is pasted to a desired position by dragging or the like.

The vase icons 42 are classified according to functions according to the contents written in the memo, and one vase icon 42 stores a plurality of flower icons, that is, information about the memo. In this example, the vase icon 4
2 is a New vase icon 4 in which a plurality of notes with new, relatively recently entered information labeled New are stored.
2A, a To-do-list vase icon 42B in which a plurality of memos with information describing matters to be made in the future are stored, and an Urgent vase in which a plurality of memos with information describing urgent contents are stored Icon 42C.

Further, the number of flowers of the vase icon 42 indicates the number of notes. In such a display, for example, one,
If two or three or more memos are stored, and three or more memos are stored, even if the actual number of memos is 10, it is displayed. Part 2
For 3, an icon of “3 flowers” is simply displayed. By doing so, the character pattern can be minimized, the memory capacity can be secured, and high-speed display processing can be performed.

[0094] In the schedule display area 50, a time axis is synthesized and displayed along one direction of the display screen, and a schedule list 51 is displayed at each corresponding time. Further, a post-it tab 43 is stuck over the schedule display area 50 and the communication display area 30.

In the database display area 60, input tabs for each database, clients61, vendors62, pe
Each tab of rsonal63 is prepared, and by clicking any of them, the tab can be pulled down to a lower menu.

(Display Screen on Portable Device Side) FIG. 7 shows an example of a display screen on the display unit 23 of the portable device 2. In this example, on the display unit 23, as shown in FIG. 6, on an initial screen as a screen saver,
The display of the time and date is displayed on the background screen similar to the three metaphors, sky, ground, and basement displayed on the display screen of the PC 1.

By operating the slider 24A, FIG.
The main screen shown in is displayed. This main screen shows P
Each of the three areas (the communication display areas 30 and 40, the schedule display area 50, and the database display area 60 in FIG. 1) displayed on the display screen of C1 have the same attributes (the communication display areas 70 and 80 in FIG. 7). The schedule display area 90 / database display area 100) is divided into three parts. This 3
The mode shifts to the mode of each area by closing any one of the two areas.

In this example, a metaphor of a natural view is adopted for each of these areas. Specifically, the upper layer of the display unit 23 is the communication display areas 70 and 80 for displaying information transmitted from the PC 1 and other information devices via the PC 1, and the sky is a sudden change in weather or the like. The background screen is displayed as an empty screen because information is an image in which information jumps in from the outside. In the communication display areas 70 and 80, an area notification area 70 for notifying information by receiving an e-mail or the like and shifting to a lower notification mode, and shifting to a lower memo mode for browsing the contents of a memo or the like. The display area can be classified into a memo area 80 for performing the display.

The middle layer of the display unit 23 is a schedule display area 5 which functions as a schedule display mode for displaying a user's schedule and the like, and a calendar mode.
0, and the ground is an image in which a person moves while considering the ground surface as time. Therefore, the background screen is displayed as a ground screen.

The lower layer of the display unit 23 is a database display area 100 for opening a directory mode and a database display mode of a lower layer for classifying a list of senders of an e-mail, an address book, and the like. The background screen is displayed as an underground screen because it means a stable one.

Of these, the area in use and the screen to be activated are enlarged and displayed, the area being used is displayed in high contrast, and the other areas are displayed in low contrast.

8A and 8C.
As shown in FIG. 1, in the same manner as in the display screen of the PC 1 shown in FIG. 1, the function of each program is set with a plurality of icons displayed by various animated characters (metaphors) according to the scenery. For example, the carrier pigeon icon 73A displayed on the sky background shown in FIG. 8A indicates an e-mail, and the flower icons 81A, 81B, and 82 shown in FIG.
A butterfly 110 shown in FIG. 9C represents a cursor, which means a voice memo and a hand light memo. Thus, these icons 73A, 81A, 81B, 82, etc.
It has the same attributes as the icons displayed on the first display screen.

Here, the PC 1 side displays the character of each icon as bitmap data corresponding to high resolution and also displays character information.
The character of each icon is configured as bitmap data corresponding to a relatively low resolution, that is, a display in which the character is simplified compared to the PC side, and character information is not displayed. By doing so, the portable device 2 can clearly display the character represented by the icon even if the display screen is quite small like that of a wristwatch, which is preferable from the viewpoint of miniaturization. Further, the bitmap data required for the character data can be reduced, and the memory capacity installed in the portable device 2 can be reduced, or the control unit for the upper address in the storage unit 22 and the use of the memory in the lower address other than the actual data unit can be used. Expand the area,
It can be effectively used to store other information and can contribute to an increase in processing speed.

When a function is assigned to the icon, a character of a carrier pigeon 73A representing an animal is displayed as a character corresponding to the function. This allows the user to visually and instantaneously determine the function assigned to each icon. Note that the function assigned to the operation unit may be changed at any time according to the content of the displayed screen.

(Details of Each Mode) FIG. 10 schematically shows such a hierarchical structure. As shown in the figure, in the present example device, the slider 24A
, Three modes (communication display mode, schedule (action) display mode (calendar mode), database display mode (directory mode)) or two communication display modes
In the case of classifying into one notify mode and memo mode, it is possible to switch to each of the four modes.

Communication display areas 70 and 80
, The pigeon icons 73A of various electronic mails and the like which are spontaneously transmitted from the PC 1 to the portable device 2 are displayed in the receiving order.

That is, by operating the slider 24A shown in FIG. 6, as shown in FIG. 8A, the communication display areas 70 and 80 are enlarged and displayed with respect to the other display areas. Then, for example, when the message pigeon icon 73A is clicked, the title of the e-mail, that is, the pictogram or face photograph 74a of the sender, the arrival time 74d, and the sender name 74
b, A window 74 on which an icon 74c indicating an electronic mail is displayed is displayed, and when further operated, the contents of the electronic mail 75 are displayed.
Here, the face photograph 74a representing the e-mail sender can be automatically converted to pictograms (text data → picture) as necessary. In this way, a plurality of types of data can be automatically converted to a desired medium.

Here, when the electronic mail arrives at the portable device 2, the information is notified by voice from the audio output unit for information notification, and the electronic mail digest and notification screen 74 is also displayed on the display unit 23. Is interrupted on the main screen.

[0109] In addition to notifying the user of the incoming call by voice, information can also be notified by tone, vibration, smell, light, electric shock, or the like. In this case, it is preferable to provide a tone color change control unit, a vibration control unit, an odor control unit, a light amount, a light color control unit, an electric control unit, and each output unit. In addition, the notification may be configured so that the degree of the notification according to the situation of the user is increased or decreased.

Note that a specific function is assigned to the message pigeon icon 73 depending on its shape and color. For example, a black message pigeon icon means that the contents, contents, and transmission items of the e-mail are urgent information, and a white message pigeon icon 73C means that the contents of the e-mail are important items. The parrot icon 73B indicates a voice mail.

As shown in FIG. 8D, the flower icon 8
When the user clicks on the button 2, a window 83 is displayed in which the title of the memo, that is, the time when the memo was input, is displayed. When further operated, a post-it in which the handwritten memo is described as shown in FIG. 8C. A window 84 of the shape is displayed. When the flower icon 82 is clicked, the display position of the message pigeon icon is displayed at the top on the display screen.

The number of petals of the flower icon 82 indicates the file size of the memo content, that is, the amount of information. The greater the number of petals, the greater the amount of information. Furthermore, a flower icon 82 and a flower icon 8 having different shape types
1A and 81B mean a voice memo. In this manner, in this example, for example, the data amount, importance, urgency, and the like are represented by the size, color, shape, movement, blinking, and the like of the icon, and the meaning of the icon is added. It is changed according to the nature of.

In the schedule display area 50,
A mode having a time axis of each unit of day, week, and month is formed so as to be switchable. Further, as shown in FIG. 9A, when a schedule (action) display mode is set by operating the slider 24A, the schedule display area 91 is displayed.
A expands to each other area, and the other communication display areas 70 and 80, database display area 1
00 is displayed in a reduced size.

In the schedule display mode 90, first, a time axis is displayed below in time units, and a schedule icon 92 for outputting a list of schedules is pasted and displayed corresponding to the time axis. The schedule icon 92 is also accompanied by a font indicating the outline of its contents.

The time axis 93A has a schedule presence / absence display area 93A substantially on a mesh, and the background screen of each of the schedule presence / absence display areas 93A is colored so that a schedule can be entered at any time. You can see at a glance. In this manner, on the display screen, the contents of the display data created or received can be organized and managed on the time axis at the time. Thus, it is possible to easily search using time as a key without taking a complicated hierarchical structure. By intentionally moving the data on a certain time axis, it can be used as a schedule.

Further, by coloring the background screen 95 indicating the past with the current time as a boundary line, the current time and how long the scheduled time is set, and whether the scheduled time is already in the past. Can be visually recognized by the user. In this example, the expression of the time axis, the past and the future, can be identified by the display color (or black and white inversion). The current position is represented by boundaries between different display colors. As a result, at the time of display, the quadrants can be seen at a glance such as past, future, and present. The date is also displayed on the time axis displayed in units of time.

In the schedule display mode 90, a five-hour view 91B (FIG. 9B) in which a schedule display for five hours can be performed in the schedule display area, and a day view 91A (FIG. 9A) in which a daily calendar is displayed. ,
Week view 91C displaying a weekly calendar (FIG. 9)
C), Month view 9 for monthly calendar display
1D (FIG. 9D).

Week view 91C for displaying one week
, The schedule icon 92 has two types, an icon 92A displayed in black and an icon 92B displayed in oblique lines. By forming these two types of icons, the contents of the schedule are distinguished.

Further, by operating the cursor 110 at the track point 24C, the calendar display screen can be scrolled in the past or future direction.
In addition, by operating the operation unit 24 to enlarge or reduce the time axis (zoom or the like) in conjunction with the scroll, for example, as shown in FIG. 9B, it is possible to pick up the interval between the time axes.

Further, the display content can be enlarged or reduced in conjunction with the time axis scale. Zoom scale (5 hours,
The display range of the data is automatically changed in accordance with a schedule of 12 hours or one week. Here, fine data accompanying each schedule or the like can be seen when the scale of the time axis is expanded or reduced (enlarged / example of FIG. 9B).
It may not be visible (reduced, as an example, FIG. 9D). Even if the size is reduced, only the volume of the schedule is displayed in terms of area, so that the general degree of clogging can be understood.
This time axis scale adjustment is based on each digit of the time axis (month, week,
It can be adjusted for each day, time, etc.). Note that a means for changing the color and brightness of the selected specific day is also effective. Also, since the time axis moves with the passage of time, the relative time position relationship between the present and the target event, event, or the like can be clearly understood.

In this example, as shown in FIG. 9C, the cursor 110 is displayed as a butterfly metaphor.
The cursor 110 can be visually strongly recognized.
Here, it is preferable that the cursor 110 be configured such that the butterfly flutters when there is an operation input from the operation unit 24 for a certain period. To configure in this way,
Based on a random number from a random number generator (not shown), the current display position and the movement pattern are calculated so that irregular movement is performed, and the index of the cursor 110 is changed in shape during movement. In addition, display control is performed such that the display mode of the cursor 110 changes, such as turning on and off each time the user moves the display. Thus, in this example, the cursor is moved,
By expressing by blinking or the like, the cursor is changed according to the nature of the data. Contrary to the above, when there is no operation input by the operation unit 24 for a certain period, a configuration in which a butterfly flutters like a screen saver may be employed.

In the database display area 100, alphabet fonts are displayed, for example, as ABCD. The user selects a desired person name, address, company name, and the like based on the alphabet.

For example, as shown in FIG. 8E, when the letter D is selected, a part of a group of data having an initial D is displayed on the window 102. When this window 102 opens, the database display area 100
Are enlarged and displayed for each of the other areas, the communication display areas 70 and 80, the schedule display area 9
0 is compressed and displayed.

Thereafter, by operating the operation unit 24, as shown in FIG. 8F, on the personal data display screen 103, information relating to Dale,. The Rukoto.

Note that while various modes are not displayed, that is, when there is no operation input by the operation unit 24 for a certain period, an initial screen is displayed on the display unit 23 as, for example, various screen savers. Alternatively, this area may be closed as necessary, and the communication display area may be displayed with a black background as if the eyelids were closed.

(Regarding Software Configuration of Portable Device)
FIG. 12 shows a diagram for achieving the above hierarchical structure.
A block diagram of a mobile device is shown.

In the figure, as a display control system for setting various modes, an operation unit 24, a voice input unit 27, first to fourth display setting units 210A to 210D, a display control unit 260, a display unit 23, The audio output unit 26 and the audio output control unit 270 are provided. The operation unit 24 is connected to the first to fourth display setting units 210A to 210D, and outputs information for selecting a screen of the display unit 23 and setting and inputting various information.
In this example, the operation unit 24 is configured by a track point 24C and the like and an interface thereof. When the track point 24C is moved up, down, left and right, the cursor moves on the screen by display control described later, and by clicking on it, selection of various menus displayed on the screen becomes possible.

Next, the first to fourth display setting sections 210A to 210A
Details of 210D will be described with reference to FIG.

The first display setting section 210A sets, as display information, an initial screen after power-on, in which font data indicating time is synthesized, on a background screen displayed by a specific metaphor. Then, the screen moves to the main screen by operating the slider 24A.

The second display setting section 210B sets a higher-level menu group including four divided areas as display information. In this example, the item has four modes “notify”, “memo”, “calendar”, and “directory”. As shown in FIG. 7, the four modes are, in order from the top of the screen of the display unit 23, the "notify" mode 70 in the upper area, the "memo" mode 80 in the upper area of the central area, and the "calendar". The "mode" 90 is displayed in the lower area of the middle area, and the "directory" mode 100 is displayed in the lower area. These four mode groups are displayed on the main screen set via the initial screen after the power of the display unit 23 is turned on. Then, by operating the slider 24A,
When any one mode is selected on the main screen, the display area of the selected mode is enlarged and displayed.

By operating the drag point 24C, the cursor can be moved on the main screen to select one of the modes. The selected information is output from the second display setting unit 210B to the third and fourth display setting units 210C and 210D.

Note that, on the main screen described above,
In the “notify” and “memo” modes, various icons 73A, 81, and 82 are displayed in the icon display column. In the “calendar” mode, a time axis in units of time is displayed, and a background color is displayed in a schedule presence / absence background coloring display area column for coloring the background when there is a schedule on the time axis. . In the "directory" mode, letters A, B, C, D, E,... Are displayed in alphabetical order in an alphabet font display field which is the first character when searching the database. One of these icons, characters A, B,... Can be selected by operating the drag point 24C and moving the cursor on the main screen. The selected information is sent from the second display setting unit 210B to the third and fourth display setting units 210C, 210C.
Output to 10D.

Based on the output from the second display setting section 210B, the third display setting section 210C further adds a plurality of icons, characters, etc., to a higher-level menu selected by the second display setting section 210B. If a lower menu exists, the lower menu group is set as display information. An example of a lower menu group is shown in FIGS. For example,
"Carrier pigeon icon" 73 in the second display setting section 210B
If A is selected, the third display setting unit 210C sets “E-mail display section” as a lower menu group.
75 (FIG. 8B) are set as display information. These lower-level menu groups are displayed in, for example, windows or the like opened on the main screen on the display unit 23 by driving of the display drive unit.

Thereafter, by operating the track point 24C, the cursor is moved on each mode screen, and one of the lower menus is selected on each mode screen. This selection information is output from the third display setting unit 210C to the fourth display setting unit 210D.

Based on the output from the second (or third) display setting unit 210B (210C), the fourth display setting unit 210D selects the selected upper menu (when there is no lower menu in the higher menu). ) Or a display screen or setting screen corresponding to a lower menu is set as display information.

When the screen is set by the fourth display setting section 210D, the display drive section controls the display of a lower menu screen on the display section 23 instead of each mode screen.

For example, when the "5 hour view" 91A is selected and displayed in the third display setting section 210C in the "calendar" mode, and the schedule icon 92 is clicked, the contents of the schedule are displayed.

In the “directory” mode, the third display setting section 210C operates the name display setting screen 102
(FIG. 8E), the fourth display setting unit 21
0D displays personal data display screen 1103 (FIG. 8F).

After that, various information corresponding to the selected item can be inputted by operating the trackball. The condition information set by operating the trackball is superimposed and displayed on the setting screen displayed on the display unit 23, and the set information can be confirmed.

When there are a plurality of lower menus,
The fifth, sixth,... Display setting sections may be formed as necessary.

(Display Setting Unit) Here, details of each display setting unit 210 will be described with reference to FIG. As shown in the figure, the display setting unit 210 mainly includes a data processing unit 230 that performs processing of a data main body based on time information from the clock unit 21 and communication information from the communication unit 25. A UI processing unit 2 that generates a background image on the display screen, character data for icons, and the like, sets the display screen itself, and processes the user interface based on the data of the user and the operation input from the operation unit 24.
40, and a storage unit 22 in which data processed by the data processing unit 230 and various data processed by the UI processing unit 240 are stored. Data processing unit 230 and U
The I processing section 240 communicates with the I processing section 240 for input processing from the operation section 24.

The data processing section 230 includes a mail processing section 230A for processing mail data, a memo processing section 230B for processing memo data, a database data processing section 230C for processing database data, and a voice memo processing for processing voice memo data. Processing sections corresponding to the functions of various applications such as processing sections 230D,... Are formed.

The types of information processed by the data processing unit 230 include communication information from the communication unit 25, time information from the clock unit 21, input / output information based on the operation of the operation unit 24, and the like. . The communication information includes, for example, the communication unit 2
5 and e-mail information transmitted / received via the e-mail information 5, and arrival time information stored in a header portion associated with the e-mail information and relating to the arrival time of the e-mail information.
The arrival time information and the e-mail information are stored as communication information in the data management unit 220 in the storage unit 22 as a set. Further, when the communication information is voice information, the voice communication information is stored in a header attached to the voice mail information, and has arrival time information on the arrival time of the voice mail information.

The input / output information includes schedule information in which a schedule has been input, and specified time information stored in the first header of the header portion of the schedule information when the user specifies the scheduled execution time of the schedule information. ,
The operation input time information stored in the second header of the header part of the schedule information and input by the user based on the timekeeping unit 21 is stored as a set in the data management unit 220 in the storage unit 22 as input / output information. Is done. When the input / output information is voice information, the voice input information includes voice memo information in which a voice memo is input, input time information in which a user inputs voice memo information stored in a header portion of the voice memo information, Having.

The UI processing unit 240 includes the data processing unit 23
A content analysis unit 242 that analyzes the content of the attached data attached to the data body processed in 0, for example, the arrival time information of the header part, the file size, the number of files, and the like;
Update processing unit 244 for updating the display screen based on time information from clock unit 21 and operation input from operation unit 24
A background screen character data control unit 250A for generating a background screen, an icon character data control unit 250B for generating icon information, a font data control unit 250C for generating character information, and each data control unit And an image synthesizing unit 252 including a state holding unit for synthesizing any of the data from 250A to 250C.

The content analysis section 242 analyzes the contents of the plurality of headers 1, 2,... Of the header section.
2A, a file size analysis unit 242B for analyzing the contents of the file size, a file number analysis unit 242C for analyzing the number of files, etc., have various data analysis functions. Further, the header analysis unit 242A also functions as a header analysis unit for the arrival time when, for example, the arrival time information is stored in the header unit, and when the designated time information is stored in the header unit, for example. , Functions as a header analysis unit for a specified time.

The background screen character data control unit 222A as a metaphor environment generation unit and a background screen generation unit
Based on a control signal from the operation input control unit 280, the execution result of the data processing unit 230 is received, and a background screen using a metaphor (character data) simulating real-world scenes and events that the user can perceive in daily life is displayed. It is formed and output to the display unit 23.

Icon display character data control unit 2
22B receives the analysis result output from the content analysis unit 242, and changes the operation state of the display screen and the like according to the data from the storage unit 22 (data corresponding to a function selected from a group of functions prepared in advance). 252. For example, when the arrival time information is stored in the header section, the icon display in the icon character data storage section 222B of the data storage section 222 is performed based on the analysis result (comparison of the arrival time) in the header analysis section 242A. Functions as an icon display character data control unit for displaying character data for display on the display screen of the display unit 23 in the order of arrival. When the specified time information is stored in the header section, the data storage section 22 is determined based on the analysis result (comparison of the specified time) by the header analysis section 242A.
2 functions as an icon display character data control unit for displaying the icon display character data in the icon character data storage unit 222B on the display screen of the display unit 23 in the order of the scheduled time.

As described above, for example, the e-mail information includes the text data as the data itself and the attached data stored in the header of the e-mail information and attached to the text data. The attached data includes, for example, the arrival time, the file size, and the like.
Then, the content analysis unit 242 determines the presence or absence of the attached data, and extracts the attached data, for example, the arrival time. For this reason, in the functional units of the header analysis unit 242A (arrival time) and the file size analysis unit 242B (data amount), the file name is included in the header of the attached data, so that extensions such as TXT, GRP graphic,
Judgment is made based on a characteristic extension such as Exls.

As described above, the information is extracted, and the icon character data control unit 222B extracts the corresponding character data based on, for example, the arrival time indicating the degree of urgency and reflects it on the object.

The image synthesizing unit 252 is provided with a state holding unit, which holds the current operation state and outputs the operation state to the display unit 23 via the display control unit 260.

The storage unit 22 includes a data management unit 220 for storing data processed by the data processing unit 230,
A data storage unit 222 for storing data processed by the I processing unit 240.

The data management section 220 has a mail data storage section 220A for managing data for processing an address book, etc., a memo data storage section 220B for managing memo data, and a voice memo data storage section 2 for managing voice memo data.
There are layers such as 20C,.

The data storage unit 222 includes a background screen character storage unit 222A for storing a plurality of types of background screen character data (time axis, empty metaphor, etc.), and icon character data for a plurality of types of icon information. A background screen character storage unit 222B for storing
A font data storage unit 222C for storing a plurality of types of font data. The display image of the applied metaphor is stored in the background screen character storage unit 222A, for example, the sky scenery and appearance of the sky metaphor.

The data storage section 222 of the storage section 22 is provided with a metaphor rule storage section in addition to the background screen character data, the icon character data, and the font data. Like the moving range and display method of characters in the sky metaphor composed of characters representing the sky scenery that represents
The metaphor rules that describe the applied metaphor rules are stored.

The operation input control unit 280 includes a voice input control unit 280A for controlling transmission of voice input information from the voice input unit 27 to the data processing unit 230 based on an operation input from the operation unit 24, Operation buttons 24A / 24B
.. A key input assignment control unit 280 for controlling the correspondence between 24C...
B, a data input control unit 280C for associating input information other than the input voice input information, for example, input information such as handwritten character input, with a font on the display unit 23, and a display screen hierarchy (upper menu⇔lower menu). Menu), a screen hierarchy control unit 280D as a hierarchy control unit for controlling to selectively display each hierarchy, a mode switching control unit 280E for controlling the switching of various modes of the display screen, the entire display screen and Control the enlargement / reduction of a specific area (change the unit time interval on the time axis so that it can be enlarged / reduced, or change the size of the icon information so that it can be enlarged / reduced in conjunction with the enlargement / reduction of the time axis) A control unit 280F, a scroll control unit 280G for controlling scrolling of the display screen, an icon movement control unit 280H for controlling movement of icon information on the display screen, etc. Control unit in response to various operations like are formed.

When the data input control unit 280C or the like functions, for example, the operation input control unit 280 detects the input coordinate position corresponding to the display unit 23 at the time of operation input, and determines the coordinate position according to the state of the display screen. Is output to the UI processing unit 240 as data.

The display control section 260 receives the current state from the image synthesizing section 252, reads out a necessary display image, forms a display screen, and outputs it to the display section 23.

As described above, the data management unit 22 described above is used.
0 is a first storage unit, and the various data storage units 222 are a second storage unit.

The data management unit 220 stores a plurality of types of information having different attributes, such as mail data (communication information) and memo data (input / output information), in the mail data storage unit 220A, the memo data storage unit 220B, and the voice memo data storage unit 22.
Classified and stored for each attribute such as 0C. Each storage unit has
In addition to the display data, a plurality of attribute information for identifying a plurality of types of information include, for example, a file-specific extension indicating mail data, a file-specific extension indicating memo data, and a file-specific extension indicating voice memo data. extension,
Etc. are stored in various formats. In addition, a plurality of pieces of time information associated with a plurality of types of information are attached to the display data. The time information includes transfer time information transferred via the communication unit, in addition to the time measured by the above-described clock unit 21.

Here, in the present invention, the "attribute information" is information for identifying a plurality of types of information, for example, types of e-mail files, memo files, schedule files, voice memo files, and the like. An example of the “attribute information” includes, for example, an extension for identifying a file format in a file system, but the present invention is not limited to these.

The icon character storage section 222B of the various data storage section 222 stores a plurality of types of icon information respectively corresponding to a plurality of pieces of attribute information. Also,
In the background screen character storage unit 222A, time axis display data for displaying the time axis, background display data for displaying the time axis display area as a background, and background screen coloring data for coloring the background of the time axis display area , Time axis coloring data for coloring and displaying a time region corresponding to the time axis of the icon information, and the like are stored.

The time-axis display data is divided into first-level display time-axis data indicating the first level displayed in units of time, and second-level data displayed in units of days.
The second hierarchical display time axis data for displaying the third hierarchical level and the third hierarchical level for displaying the third hierarchical level divided and displayed on a weekly basis
And fourth hierarchical display time axis data for displaying the fourth hierarchical level which is divided and displayed on a monthly basis.

Therefore, the control means 210 selects the icon information corresponding to each of the attributes of the plurality of types of information based on the attribute information, and selects the selected icon information based on the time information related to the plurality of types of information. Are displayed on the display screen such that are arranged at corresponding times on the time axis.
The background screen character data control unit 250A and the image synthesis unit 252 form a background screen generation unit.

When the plurality of types of information are electronic mail information transmitted and received via the communication section 25, the header section of the electronic mail information has arrival time information on the arrival time. Therefore, the control means 210 performs the display processing of the icon information on the display screen in the order of arrival based on the arrival time information.

If the plurality of types of information are memo information to be input by operation, the header portion of the memo information has input time information of the input operation. Therefore, the control means 210
Displays icon information on the display screen in the order of creation based on the input time information.

When a plurality of types of information are a to-do list, the header section has designated time information in which the user designates a scheduled execution time. Therefore, the control means 210
Performs display processing of the icon information on the display screen in the order of the scheduled time based on the designated time information.

As described above, the display device of the present invention has the first storage means, the second storage means, the display means, and the control means.

(Display Process of Menu Screen) Referring to FIG. 8A showing an example of the display screen of the present example, for example, the background screen is represented as an empty metaphor, and the object in the background screen indicates the start of the application program. And a message pigeon icon 73A. Here, the content analysis unit 242 analyzes information attached to the header part of the e-mail information as attached data, such as the arrival time, the file size, and the like. The character data control unit 250 performs an icon display process based on the arrival time, the file size, and the like, such as the order of arrival indicating the degree of urgency, a different shape depending on the file size, and the like.

The user can operate these objects by selecting (pointing operation) on the operation unit 24.

When the pigeon pigeon icon 73A is selected, the corresponding application (e-mail related program) is started, and the application display window (lower-level menu, lower-level instruction screen) is displayed.

That is, first, when the user selects the message pigeon icon 73A while the operation world (empty metaphor screen) as shown on the display unit 23 is displayed,
The input coordinates corresponding to the display unit 23 are detected by the operation input control unit 280, and corresponding data (application start request) is generated from the current screen state (the message pigeon icon 73A is displayed at the input position). You. The data processing unit 230 receives the data via the character data control unit 250, selectively executes a corresponding process from an application program (e-mail related program), and outputs an execution result (completion of application startup, etc.). .

The character data control unit 250 receives the execution result from the data processing unit 230, obtains the rules (rules related to application startup) stored in the metaphor rule storage unit and the like, and displays the corresponding screen display state (font data control (The font is synthesized and displayed on the background screen). The image combining unit 252 changes the operation state according to the instruction, and outputs a new operation state to the display control unit 260. The display control unit 260 reads a necessary display image (application start screen or the like) and forms a display screen according to the new operation state.
Output to the display unit 23. In this way, the application start screen is displayed as a result of the user selecting the message pigeon icon 73A.

During the execution of the application, input to the application is performed by selecting an object such as a list selection or a soft button on the display screen with a cursor, and thereafter, an object on the display screen is selected and a processing instruction is given. Do. When you finish running the application,
The window closes and returns to the empty metaphor screen before startup.
As a result, the details of the content and the situation are displayed on the screen, and the state of selection and execution of the application is visually shown to the user.

Further, the operation unit 24 generates data (input of an application or the like) from the subsequent coordinate position of the user input according to the received new operation state. This data is similarly received by the data processing unit 230 and processed as input data during execution of the application. As a result, the font data control unit 250C calls the corresponding font data, changes the operation state (display screen or the like) of the image synthesis unit 252, and changes the display on the display unit 23 via the display control unit 260.

When the user performs an input to terminate the application, the operation state of the image synthesizing unit 252 is similarly changed, the window is closed, and the screen returns to an empty metaphor screen (main screen). The display control unit 260 includes the image synthesizing unit 2
Upon receiving the changed operation state of 52, the character is displayed (image change, movement, etc.) and output to the display unit 23. With this operation, the execution state is visually shown to the user.

As described above, by providing a unified operation world with an empty metaphor, the execution contents of the application can be easily understood visually, and the display contents and operations can be easily understood only by the knowledge obtained by the user on a daily basis. it can.

As an example, as shown in FIG.
In order to display a message in the post-it 84, the data is written in advance with another device such as a memo tablet using ink data, and is saved as a text file. This text file is transferred to the mobile device 2 and the communication unit 25
Is stored in the storage unit 22 using the data processing unit 230 via the. The post-it display area 84 is generated by the background screen character data control unit 250A using the UI processing unit 240, and the font data corresponding to the text data is synthesized and displayed on the post-it display area 84 by the font data storage unit 222A. Just do it. Here, what is drawn on the tablet is stored, for example, in the form of BMD (bitmap data). It should be noted that the information may be line information and may be made finer.

Further, as an example, when scroll processing is performed, the scroll control section 280G normally updates the update processing section 244 based on the operation section 24.
A process of sequentially rewriting the display screen of the display unit 23 is performed. However, it is preferable to perform a process of reading the current time one hour ahead, for example, without moving the background screen itself, changing only the time data, and displaying the data again. That is,
At one end, flash the entire screen and display the background screen. Next, data of one hour ahead is generated, and various characters are synthesized. By moving the screen in one direction, the update processing by the update processing unit 244 is repeated. However, it is preferable that only a new display area corresponding to the moved shortage is generated. In other words, a display algorithm that retains the state of the display screen common before and after scrolling, redisplays the screen with the state retained after scrolling, and writes only the display area to be newly added once again is used in advance. You should prepare it.

When performing a display process for changing the color of the background screen at a scheduled time, it is necessary to analyze the start time and end time of the period. That is, the start time and the end time are stored in the data body as accompanying data. Further, the start time and the scheduled time may be combined and provided as accompanying data. Since the mail has various data such as attendees as a plurality of headers in addition to the importance, the title and the time can be displayed at the same time. Thereby, the degree of clogging of the schedule can be read.

Further, when performing scaling processing,
A plurality of enlarged or reduced character patterns are prepared based on the enlargement / reduction control unit 280F and the update processing unit 244, and are updated one by one according to the operation status of the operation unit.

Here, various data tables for displaying menus will be described with reference to FIGS. 16 and 17 with respect to the display processing of the initial screen and the main screen displayed when the power is turned on.

FIG. 16B shows a menu data table (Ta
ble2), the table stores menu name data for identifying each menu data, menu format data indicating a format for displaying the menu, and character data for the background screen in FIG. 17A used as a menu background. .., Indicating the address of the icon, and the layout position data indicating the layout position of each icon by X and Y coordinates on the screen. It is preferable to store next-level menu number data indicating a menu located at the next level and icon number data representing an icon provided in the menu.

The menus defined by this menu data table are the main screen and each mode of the next hierarchical level of the menu. An icon corresponding to the function of the scheduler of this example is displayed on the desk menu.

FIG. 16A is an icon data table (Table 1) holding a plurality of icon data.
The table identifies each icon data, and function name data, which is the name of the function corresponding to each icon, and FIG.
Are stored as character data pointers DI1 to DI11,..., Which are pointers indicating addresses at which the character data of the respective icons are stored, and function programs F1 to F9 of FIG. And a function program pointer which is a pointer indicating the address at which the data is stored.

The various data tables for displaying the menu have been described above. Next, the display processing will be briefly described.

A menu data table (Table 2 [FIG. 1
6B]), the menu format of the menu to be displayed is referred to, and if the screen is full screen, the background screen character data pointers BI1 to BI7,... Display the entire screen. In the case of the pop-up format, the window frame of the pop-up window is displayed, and the background screen character data indicated by the pointer is displayed in the window. Next, referring to the icons to be combined and the icon arrangement position data in the menu data table (Table 2), the icon data table (Ta
ble1), character data pointers DI1 to DI11 of the icon data corresponding to the icons described above.
The icon to be displayed is assembled with reference to the character data (FIG. 17B) indicated by, and the assembled icon is placed in the layout data (X
1, Y1),... Are arranged and displayed on the screen.

When an icon is selected, the corresponding function program (F1 to F9 in FIG. 14) is activated by referring to the function program pointers F1 to F8,.

(Mail Processing Unit) The mail processing unit 230A in the data processing unit 230 includes mail input / output means (not shown), mail transmission / reception control means, destination list management means, and the like. The mail input / output unit has a mail creation processing unit for creating a new mail, a transmission operation processing unit for sending a mail, and a mail editing processing unit for changing a mail destination list. The mail transmission / reception control unit includes a mail transmission processing unit that transmits mail according to a destination list, and a mail reception processing unit that notifies a recipient that the mail has been received. The destination list management means includes a destination list initialization processing unit that initializes a destination list, a destination list addition processing unit that adds a new destination, and a destination list deletion processing unit that deletes a destination.

The display screen of the electronic mail system is configured as shown in FIG. 2 on the PC side.
The display screen window 34 includes, for example, a name 34a, a title 34b, a company name 34c, a company address 34d, a company telephone number 34e, a company FAX number 34f, a home telephone number 34g, a home e-mail address 34h, and a comment. 34i is provided for each column.

(Data Structure) Here, in order to perform the window display as described above, it is stored in the mail data storage section 220A in the data management section 220 in the storage section 22.
The data structure used in the program will be described. FIG. 14 shows a hierarchical structure of data stored in the mail data storage unit 220A.

The storage unit 22 includes a control unit 22A in which a management program is stored, an electronic mail-related program F
1 including various application programs F1 to F9,
It has various tables including Tables 1 and 2 described above, various data storage units 222 including character data 222A, 222B and font data 220C, and a data management unit 220.

When the storage unit 22 constitutes the information recording medium of the present invention for storing at least information for generating a display image, it must have at least the various information shown in FIG. Good.

In this case, a plurality of pieces of attribute information for identifying a plurality of kinds of information, a plurality of pieces of time information related to the plurality of kinds of information, and the like are stored in each header portion. A plurality of types of icon information respectively corresponding to the plurality of attribute information are stored as various icon character data 222B, and time axis display data for displaying the time axis is stored as background screen character data 222A. Further, based on the attribute information, icon information corresponding to each of the plurality of types of information attributes is selected, and based on the time information related to the plurality of types of information, the selected icon information is converted to a corresponding time on the time axis. Information for controlling the display on the display screen so as to be arranged respectively is stored as the management program 22A.

The data management section 220 has a mail data storage section 220A, a memo data storage section 220B, a database data storage section 220C, and so on.

The mail data storage section 220A is formed of a plurality of files 1, 2,..., And one file has header sections 220A-1, 220A-2, 220A-
... And the actual data section 22 relating to the contents of the mail
OA-15 is formed. In the header section 220A, the arrival time as the header 1 (220A-1) and the header 2 (22A-1)
0A-2) as the file size and header 3 (220A
Information such as a name (ID) is stored as -3).

The mail data storage section 220 A is created for each node displayed in the display window shown in FIG. 2, for example, and stored in the storage section 22. For details, file size, incoming date and time, name (ID), bitmap data of the sender's face photo (or pictograph), face photo display position, face photo size, opening date and time, transfer date and time, mail display window Display position, size of the mail display window, time display position in the lower column of the mail display window,
The size of the time display area, the size of the time display characters, the size of the characters (font) of the mail content, the actual data (data body) related to the mail content, the sender list, the forwarding destination information (address, destination address, etc.) , A list of attributes, pointers to icons, and comments. Note that, in this example, these accompanying information other than the actual data (data body) is, for example, header 1, header 2,...
These contents will be analyzed.

In addition, as various tables, it is preferable to have a window management table (for a mail display screen), a destination list management table, and the like.

Here, the name (ID) is an identifier of each user, and usually the user's name and nickname are used as the identifier. In the destination address, an address to which a mail is transmitted is set. In a general e-mail, the e-mail address is information for designating a storage location of the storage unit, and the storage location is accessed to grasp the incoming state of the mail addressed to the user. The opening date and time is given by the real-time clock in the clock unit 21, and the date and time when the received mail is first seen is set. In the transfer date and time, the date and time at which the mail was transmitted (forwarded or returned) is set according to a destination list set in advance for the received mail. The attribute is set with a flag indicating whether the recipient, which is a node corresponding to the data structure, can edit the destination list, or whether the recipient is absent. In the display coordinates and the size, the size of the coordinates, character strings, icons, and the like in the display window that displays the character strings, icons, and the like indicated by the nodes corresponding to the data structures are set. As the pointer to the icon, a pointer to an area in which an icon image (image information, character data) indicating a node corresponding to the data structure displayed in the display window is set. In the comment, the input comment is set. Incidentally, the number of these entries may be variably formed.

The window management table is a set of data sets for displaying each window group on the display screen, and is stored in the storage unit. The window management table has items such as a window name, window coordinates, and a window width and height set by the number of pixels.
For example, it is composed of a set of data sets corresponding to each item such as a message display window and an address book display window.

[0201] In the mail data storage section 220A,
It has a destination list management table. The destination list management table holds various information of all registered users,
The held various information is displayed in a window in a list format. This table has items such as a name and a destination address, and is composed of a set of data sets corresponding to the above items of each registered user.

(Operation of Portable Device) FIG. 18 is a flowchart showing the operation of the portable device. First, when the portable device is turned on and started, the CPU accesses the PC via the communication unit according to the boot program stored in the storage unit, and stores the terminal OS stored in the storage unit.
Read protocol and other necessary data.

Next, the portable device 2 displays on the display section 23, for example, an initial screen as shown in FIG. Next, when moving to the main screen, the icons are assigned functions for the icons based on the data, and are displayed as characters in the display area. This allows the user to visually and instantaneously determine each function, thereby realizing a portable device that is easier to use. In this example, the displayed character may be displayed as a still image, or may be displayed as a moving image if necessary.

When the power is turned on, an initial screen is first displayed (step "S" 1), and the main screen is displayed by operating the operation unit (S2) (S3). The display of this main screen is performed by the first display setting unit 2 shown in FIG.
This is performed based on the display information from 10A. That is,
The CPU 28 shown in FIG. 2 calls display information corresponding to the main screen stored in the storage unit 22, transfers this information to the display unit 23, and displays it.

This main screen is as shown in FIG. 7, and it is possible to select any one of the upper menus displayed in three parts.

Here, S3 for displaying the main screen
Then, in more detail, a process like the flowchart shown in FIGS. 20A and 20B is performed. First, when any operation is performed, a state occurs in which the screen must be updated. Then, it is determined whether the main screen has been updated (S3).
0), background display processing of a background screen for updating the screen is performed (S32). Since this background display process is a background display process for generating a main screen, for example, FIG.
A, the background screen character data BI1 to BI7 shown in FIG.
.. Are attached to specific positions to perform display control.

Next, is there mail? Command (S3
If “YES” to 3), FIG. 8A is displayed on the display screen.
Is displayed, and information is notified (S34). Since this information notification is performed only when the mail arrives at the portable device, it is first determined in S34a whether or not the first (first) display is performed (S34a), and the face photograph and topic of the sender of the mail are temporarily stored. When the display is performed for a predetermined period of time, for example, one second, the display is automatically turned off (S34b).

Next, the contents of the mail are analyzed (S3
5). Here, data that is the content of the mail itself sent by communication is processed (S35a). For example, first, the data is stored in the data management unit 220 in the storage unit 22.
Is stored in the mail data storage unit 220A. further,
When data is transmitted, a plurality of headers (220A-1) are placed at the beginning of the data, as shown in an electromagnetic signal shown in FIG.
... 220A-N), the header part (2
20A-1... 220A-N) is read by the header analysis unit 242A. Since the file size is information accompanying the file size, the file size is analyzed (S35c).

[0209] In addition, although not described in detail, the name of the sender of the mail is analyzed by analyzing the header portion.

In this way, the character corresponding to each of the background screen character control unit and the icon character control unit shown in FIG. 13 is changed from a plurality of characters composed of bitmap images stored in the storage unit. A bitmap image of the dove icon is selected, and, for example, the dove icon is synthesized and displayed on the background screen (S36).

Thereafter, it is determined whether there is another mail (S
37) If there is an e-mail, S34 to S36 are repeated, and if there is no e-mail, the process is in a standby state until there is an update (repetition of S30 and S31). The program waits until a key input occurs. If you repeat these steps until there are no more emails,
Dove icons are arranged side by side.

In S35, for example, the degree of urgency is defined by, for example, early or late arrival time. In addition, if the degree of urgency is high, a red pigeon icon is displayed. Is determined to be attached, the header analysis unit sets the urgency to be low and the urgency to be high based on a certain time before the current time, based on this analysis. Thus, the icon of the desired character is synthesized on the display screen by the character data control unit.

[0213] Further, since information such as the time at which the e-mail was written is stored in the header portion, a pigeon icon can be pasted at a desired position on the time axis in chronological order based on such information.

As in the case of the above mail, in the case of a memo, it is determined whether or not the main screen has been updated (S41), and the background screen is displayed (S42).

Next, are there any notes? Command (S43)
If "YES", a post-it window as shown in FIG. 1 is displayed on the display screen (S44).

[0216] In S43, a judgment block for calling "What kind of memo is the memo?" May be included.

Then, content analysis similar to the above S35 is performed (S45). That is, since information such as the time when the memo was written is stored in the header portion, the post-it can be attached to a desired position on the time axis based on the information.
If the data includes text data, the text data is received, and the font data control unit extracts the corresponding font data based on the font data storage unit and the data processing unit, and sends the extracted font data to the image synthesis unit. Output. Then, 1234, ABC, and
Since there is DE font data, character information is output by bringing them one by one and pasting them on post-it (S46). The font data storage unit stores not only Mincho fonts and Gothic fonts but also various font data that creates a handwritten character atmosphere.

Thereafter, it is determined whether there is another memo (S4).
7) If there is a memo, S44 to S46 are repeated, and if there is no memo, the process goes to a standby state until there is an update (repetition of S40, 41). When such steps are repeated until there is no more note, the post-it is arranged in parallel on the background screen as shown in FIG. 1, for example.

[0219] When displaying various icons related to various kinds of information such as a memo icon, a schedule icon, and a voice memo on the display screen, the icons are combined and displayed by the same method. Detailed description is omitted.

Further, by analyzing the file size, the icon character data control unit selects a flower icon having a large number of petals when the file size is a certain size or more, and selects a flower icon having a large number of petals when the file size is a certain size or less. By controlling to select a few flower icons, an icon with many petals and an icon with few petals are combined and displayed on the display screen.

In the background display processing of S32 and S44, since the time axis is displayed on the main screen in this example, the flow for generating this time axis will be described with reference to the flowchart of FIG. 24A. explain.

If there is an update such as scrolling, enlargement / reduction display, mode switching, etc. by operating the operation unit (S50),
The display area (display scale) in the standard size displayed on the display screen is determined (S51), and the time axis is synthesized and displayed on the background screen using the scale (S52). Next, the current time is confirmed (S53), and based on the display scale and the current time, the time displayed at one end and the other end of the time axis on the display screen and the display position of the arrow indicating the current time are determined (step S53). S54). Thereafter, the background screen past the current time is colored and displayed (S55). Since the current time is sequentially advanced by the timekeeping unit, it goes without saying that the time axis display is constantly updated as the time elapses in the timekeeping unit in order to match the current time. As a result, the user can visually see the time axis and the plurality of types of information as they sequentially move on the display screen as time elapses.

Further, the time axis of the present example is formed by connecting a plurality of grid-like squares for each unit time, and the squares of the scheduled time axis are colored on the background screen. In this case as well, as shown in FIG. 21B, in the background display processing of S32 and S44, the character is synthesized and displayed at the corresponding time on the time axis (S60), and then the corresponding area of the square, the planned presence / absence area is colored It should be displayed (S6
1).

Next, returning to FIG. 18, when the main screen is displayed in this way, if the screen is restored by operating the operation unit, the screen returns to the initial screen (S4). , And waits for another operation.

If there is a mode change operation using the operation unit (S6), the mode switching control unit 280E shown in FIG.
Displays the background screen in each mode (S
7). This mode change operation is performed by operating the operation unit (slider) up and down. Here, the display processing of the main screen (S3) is different from the display processing of the main screen (S3) only in that the character for the background screen is different. S3
0 to S37, S40 to S47),
Detailed description is omitted.

Similarly, when the screen is restored by operating the operation unit, the screen returns to the main screen (S8), and when there is no operation, the operation is in a standby state until another operation is performed.

If a scroll operation is performed by the operation unit (S10), the scroll control unit 230 shown in FIG.
By G, the background screen after scrolling is displayed (S11). This scroll operation is performed by moving the cursor on the screen by operating the operation unit.
Here, the display processing of the main screen (S3) is different from the display processing of the main screen (S3) only in that the character for the background screen is different.
0A and S30 to S37 and S40 to S47 in FIG. 20B), and a detailed description thereof will be omitted.

Similarly, when the screen is restored by operating the operation unit, the screen returns to the screen of each mode (S12), and when there is no screen, the apparatus is in a standby state until another operation is performed.

If there is an operation of enlargement or reduction by the operation unit (S14), the enlargement / reduction control unit 28 shown in FIG.
By 0F, the background screen after the enlargement or reduction is displayed (S15). Zooming or the like can be realized by operating a designated operation unit. Here, the display processing (S2) of the main screen also includes a character for the background screen,
Only the size of the character for each icon is different.
(More specifically, S30 to S37 in FIGS. 20A and 20B,
Since these steps are almost the same as steps S40 to S47), a detailed description thereof will be omitted. Thereafter, the program waits again until a key input occurs, and if a key input is detected, determines whether the key input is for canceling zooming.

Similarly, when the screen is restored by operating the operation unit, the screen is returned to the screen after each scroll (S16).
If there is no other operation, the operation waits until another operation is performed. Thereafter, when there is another display change operation, the above various operations are performed (S5, S4, S13, 17).

If there is no other display change operation, the processing A (S
Perform 18). In the A process, as shown in FIG. 19, since various icons are displayed on each screen, the user determines whether or not to select a desired icon (S19).

Here, selection of an icon is performed by moving the cursor on the screen by operating the operation unit, positioning the cursor on one of the icons, and clicking. Thereby, S19 of FIG. 19 is YES.
Becomes As an example, information on the icon selected by operating the operation unit is output from the second display setting unit 210B to the third and fourth display setting units 210C and 210D. The third display setting unit that has received the information input determines whether or not the selected icon further includes a plurality of lower-level menu groups (S20). When the third display setting unit determines that a plurality of lower-level menu groups exist in the selected icon, the lower-level menu groups are displayed on each mode screen. This display is performed by opening a window on each mode screen by the third display setting unit and displaying the lower-level menu group in this window in parallel. For example, FIG.
Step 1 of the icons of the upper menu group shown in FIG.
When the "red pigeon icon" is selected in step 9, a lower-level menu group corresponding to this icon, that is, "e-mail display screen 1" is displayed (S21).

The selection of the lower menu is performed by operating the operation unit in the same manner as the selection of the icon. If any one of the lower-level menus is selected by the operation of the operation unit, the determination in S23 is YES, and the information of the selected lower-level menu is output from the third display setting unit to the fourth display setting unit. Then, the process proceeds to S24. Note that S2
When the determination of 0 is NO, the process similarly proceeds to S24.
The case where the determination in step S20 is NO is a case where an object having no lower menu group is selected. In this case, the fourth display setting unit determines that the setting screen corresponding to the selected icon exists based on the output from the second display setting unit. The steps from S24 are performed by the function of. Alternatively, information indicating that the corresponding lower-level menu group does not exist may be output to the fourth display setting unit by the third display setting unit.

By performing the above-described operations of S19 to S24, any one item is specified, and thereafter the operations of S25 and thereafter are performed by the function of the fourth display setting unit. The fourth display setting unit displays a setting screen corresponding to the specified item on the display unit. Then, various inputs are performed by moving and clicking the cursor displayed in the setting screen by the data input control unit 280C based on the operation of the operation unit. If an input is performed by operating the operation unit, S25 becomes YES, and the input information is displayed on the setting screen (S26). Thereafter, when the input is completed by an operation described later, S
27 is YES, the process returns to S3, 7, 11, and 15, and the main screen is displayed again. Also, in this setting screen,
If another lower menu included in the same class is displayed and another lower menu is selected on this setting screen, S28 becomes YES and returns to S21, where the selected lower menu is displayed. The corresponding setting screen is displayed. If S28 and S27 are NO, S25 to S27 are repeated.

The hierarchy of the upper menu and the lower menu in the first to fourth setting sections is controlled by the screen hierarchy control section 280D based on the operation of the operation section 24.

When moving an icon to a desired position, the icon movement control section 280H is controlled based on the operation of the operation section. Based on this control, for example, the icon character data control unit 2 of the UI processing unit 240
The desired icon and the icon pasting position at 50B are determined and output to the display unit.

In the case where voice input or the like is performed, the operation unit 2
4, a voice is input from the voice input unit 27.
The voice information is moved to the data management unit by the voice input control unit 280A. When the specified time comes, the operation unit causes the audio output control unit 270 to retrieve the stored audio information,
In addition to outputting sound to the sound output unit 26, desired display is also performed on the display unit via the display control unit.

In the present example, in the calendar display mode included in the schedule display mode, a butterfly cursor is used, and while the cursor is moving, the butterfly wings are displayed so as to flutter. This makes it easy to visually recognize the cursor even when the background screen is formed by a plurality of meshes such as a calendar. As an example of performing such a display process, it is preferable to perform a process as shown in FIG. 22, for example.

That is, in FIG. 22, first, it is determined whether or not there is an instruction to display a cursor (S90). If there is no instruction, the apparatus enters a standby state until an instruction to display a cursor is issued. When there is an instruction, the character data control unit or the like performs a synthetic display of the butterfly character data stored in the storage unit on the indicated coordinates indicated by the cursor (S
91).

Then, it is determined whether or not the operation of moving the butterfly cursor has been performed (S92). If there is no moving operation, the process ends. If there is a moving operation, S93 is performed. S9
In No. 3, a control is performed to alternately display a plurality of butterfly character data formed stepwise so that the butterfly wings are displayed as if they are shaking, and the random number generation unit (not shown) generates the data. Control is performed to move the character data of the butterfly based on a random designated coordinate value of the cursor.

It is determined whether or not the cursor moving operation has been completed (S94). If the cursor moving operation is continued, S93 is repeated, and if completed, the process is terminated.

Next, a method of using the PC 1 or the portable device 2 will be described. First, while the menu screen is displayed, the user operates an icon to which various functions are assigned. When an item is selected, at S6 shown in FIG.
“Communication mode” is selected from the upper menu group shown in FIG.
Is selected, an "E-mail display screen" is displayed in S21 via S19. The user sets and inputs data related to the e-mail based on the operation unit while viewing the setting screen. Here, an example of the setting screen is shown in FIG.
In the figure, in the setting screen 34, display columns are displayed vertically in parallel.

By setting the position of the cursor (bar for setting conditions) by operating the operation unit, the cursor is set at a desired position in each display column, and the conditions can be changed by moving the cursor. Hereinafter, similarly, by the above procedure,
The setting of various inputs for the PC 1 or the portable device 2 ends.

When these various inputs are completed, for example, P
In C1, "File" in the pull-down menu column in the screen
Is selected with the cursor, the lower menu can be selected and saved, for example. The data is automatically set as the data of the screen data setting items,
Will be sent to the side.

Then, when the data thus input is transmitted from, for example, the portable device 2 to the PC 1, the P
C1 collates with the database and displays a screen on the display unit of the portable device. In this way, the user can input and browse various schedules from the mobile device 2.

It is needless to say that the above-described software configuration shown in FIGS. 12 and 13 and the memory map shown in FIG. 14 can be applied not only to portable equipment but also to other information processing apparatuses, PCs, EWS and the like. .

[Second Embodiment] Next, a second embodiment of the display device according to the present invention will be described with reference to FIGS. The detailed description of the same configuration as the first embodiment will be omitted. In this example, the configuration of the display screen is configured as shown in FIGS. 23A and 23B.

The portable device 300 of this example has a cursor button 301A, a tab switch 301B, and a rugby ball type elliptical rotation input unit as the operation unit 301.
An option button 301C and a record button 310D are formed.

This cursor button 301A is
A rotation operation for rotating in the θ direction about the vertical axis Y of
It is configured to be able to perform three operations: a push-up operation of pushing in the direction of arrow O and then rising in the direction of arrow P, and a push-down operation of pushing in the direction of arrow O and then descending in the direction of arrow Q.

The tab switch 301B is configured so as to be able to push up and down in a direction perpendicular to the plane of the drawing.

FIG. 23A shows an initial screen 310 after the power is turned on.
(Default view). On the initial screen 310, an area 310A for displaying the current day of the week displayed in the upper area of the display unit 302, a time display area 310B for displaying the current time displayed in the middle area, and a display unit A date display area 310C that is displayed in the lower area of 302 and displays the current date can be displayed.

After the power is turned on, the display unit 302
As shown in A, an initial screen 310 is first displayed, and a schedule display mode 320A as a main screen shown in FIG. 23B is displayed by operating the operation unit 301B.

In the schedule display mode 320A, a date display area 330 at the top of the display screen, a vertical line displaying a predetermined time axis, a schedule display area 340 as a calendar, and a schedule display area 340 Time axis display area 3 indicating time unit
50A and icon display area 360 at the bottom of the display screen
And

At the lower end of the date display area 330, a black bar 334, which is an arrow indicating the current time on the schedule display area 340, is formed and functions as a cursor.

The background screen of the time region indicating the past is displayed as a background screen coloring display area 342 with the vertical line 344 of the time axis indicated by the black bar 334 as a boundary, for example, colored in gray or the like. .

The schedule display area 340 has a schedule icon 346 at a desired scheduled time, and by operating the schedule icon 346, the schedule of the lower menu can be browsed.

In the time axis display area 350A, a position on the time axis corresponding to the schedule icon 346 is formed as a scheduled presence / absence color display area 352 for color display. In FIG. 23B, the schedule icon 346 is displayed.
Is formed from 9 o'clock to 12 o'clock,
Also in the scheduled presence / absence coloring display area 352, 1
Two o'clock is colored so that the presence or absence of a plan can be seen at a glance on the time axis. In this way, the user can easily find the current schedule visually.

In icon display area 360, a microphone icon 362 indicating that a voice memo has been registered and an envelope icon 364 indicating that a message has been received by e-mail are displayed. By operating each of these icons in the same manner as the schedule icon 346, it is possible to listen to a voice memo in the lower menu, browse an e-mail, and the like.

By pressing the tab switch 301B, the time axis of the schedule display mode 320A is switched between a 6-hour mode, a 12-hour mode, a one-week mode, and a monthly mode, and each mode is zoomed in (enlarged display).
can do. By lifting the tab switch 301B, zoom out (reduced display) can be performed. FIG. 23B shows a 6-hour mode, FIG. 26A shows a 12-hour mode, and FIG. 26B shows a 1-week mode.

In FIG. 27A, cursor button 301
By pressing A, the mode is switched from the schedule display mode to the memo mode. That is, the cursor button 301A
27, the date display area 330 jumps downward to the icon area 360 as shown in FIG. 27B. Then, the cursor button 301A is rotated to move it to the position of the desired icon, and if it is moved to the position of the microphone icon 362A, pressing the tab switch 301B allows the recorded content to be transmitted via the audio output unit. Can hear.

Next, when incorporating this recording information into the schedule display area 340, as shown in FIG. 27C, the microphone icon is raised and brought into contact with the black bar 334 by lifting the tab switch 301B.
Then, by pushing up the cursor button 301A as shown in FIG. 28A, the date display area 330 is raised as shown in FIG. 28B. After that, the cursor button 301A
By rotating, the microphone icon 362A is moved to a desired time, for example, 6:00 PM, as shown in FIG. 28C. By depressing the tab switch 301B, the microphone icon 362A moves away from the cursor, and the microphone icon 362A is displayed in the schedule display area 340.
Paste it on the top to complete the schedule integration on the time axis.

Furthermore, as shown in FIG. 29A, the mode can be switched by operating the option button 301C once, and the original mode (schedule display mode) can be returned by pressing the option button again.

In this example, the mode is switched to the database mode as shown in FIG. 29B. Here, in the database mode, four categories "Clients""Vendo
It is classified into "rs", "Personal", and "Setting". still,
The “Setting” mode is a mode for performing time adjustment and various adjustments.

By operating the cursor button 301A, the black bar (cursor) is moved in the horizontal direction, any category is selected, and as shown in FIG. 29C, the "Clients" list is selected by operating the tab switch 301B. I do. Then, a screen as shown in FIG. 30A is displayed,
By rotating the cursor button 301A, the selection bar moves in the horizontal direction, and an initial, for example, K is selected.

Then, as shown in FIG. 30B, a virtual cursor that can be moved up and down is displayed beside the name list, and a desired name can be selected by pushing up or down the cursor button 301A. When the cursor reaches an end of the display unit 302, scrolling is automatically performed.

Then, by operating the tab switch 301B, the information given by the name shown in FIG. 30C can be browsed. Thereafter, by moving the virtual cursor up and down by pushing up or pushing down the cursor button 301A, it is possible to scroll and search for desired information.

When an e-mail is received, a message shown in FIG.
A notification window as shown in FIG. The notification window can display a photograph of the caller's face, the name of the caller, and the time of the call.

If the information is not urgent, the information is not notified, and the envelope icon 364 is automatically pasted. The user can browse the contents later by selecting the icon 364. .

When recording a voice memo,
By operating the recording button 301D, recording can be performed within a period in which the display screen of FIG. 31 is displayed.

In the schedule display mode shown in FIG. 23B, the user can scroll in the same direction as the time axis by rotating the cursor button 301A. Accordingly, when the operation unit is operated by wearing a wrist-worn type portable device, such as a clock, on the wrist, the configuration of the operation unit according to the related art can change the display screen, move the cursor, scroll the screen, and the like. When performing an operation, there is a problem in that it is not possible to properly specify a position on the screen surface or scroll from the viewpoint of the mounting direction of the arm and the size of the operation unit.
On the other hand, in the present example, since the operation unit is formed so as to be rotatable in the same direction as the scroll direction, the operability for the user is improved.

With a pointer that can be moved in all directions, for example, a mouse, a track point, or the like, the cursor is swung and the instruction is rather unstable. On the other hand, in this example, the cursor can be moved only in one axis direction, so that the movement can be performed stably and accurately. In addition, by the rotation operation rotatable along the one-axis direction, the movement of the cursor in the one-axis direction can be moved more quickly while being stabilized using centrifugal force and inertia when rotating. . Thus, by performing the rotation operation, it is possible to accurately instruct the cursor in the horizontal direction and to move the cursor at a high speed. Since the execution of the operation and the response of the screen corresponding thereto are univocal, an easy-to-understand interface can be realized.

Further, in this example, a function of displaying data outside the display frame (catch net metaphor) is provided. The memo (or object) on which the time axis is pasted moves as time passes and the time axis on the display moves. However, even if the time at the position where the label is stuck goes out of the display, the necessary memo remains without disappearing outside the display frame.

In such a case, for example, the display unit 302
A dedicated catch net area is provided over the left end area indicating the past, and data off the time axis is pasted there. That is, the catch net area displays icon information that disappears from the display screen with the passage of time in the time axis display area.

The display processing of the catch net area is performed as shown in the flowchart of FIG. 21C.

That is, together with the updating process of the time axis movement, it is determined whether or not the icon has entered the catch net area (S70). If it does, icons such as stacking are displayed in the catch net area regardless of the time axis (S71). If not, icons are displayed according to a normal time axis. The icon in the catch net area is displayed on the display screen in the catch net area after K hours from the scheduled occurrence time of the schedule icon (when the difference between the scheduled input time and the current time exceeds K hours). It is deleted (S72). This allows the icon to disappear after a certain K time has elapsed.

FIG. 24 shows the hierarchical structure of the screen display as described above. Switching between the database display mode and the schedule mode is possible by the operation unit.

FIGS. 25A to 25C show display screens when the screen is scrolled and zooming is performed. When performing this scroll processing,
First, as shown in FIG. 32A, the cursor button 301A, which is a rugby ball type operation unit, is rotated (S10).
0), the rotation direction is determined by processing A (S101).

That is, in the process A of S101, it is first determined whether the rotation direction is clockwise or counterclockwise (S110). Next, in the case of rotation in the left direction, the rotation amount corresponding to the left rotation, such as the rotation angle and the number of rotations, is detected (S111).
a). Next, the scroll movement amount on the display screen with respect to the detected rotation amount is calculated using a rotation amount-scroll movement amount conversion table prepared in a storage unit or the like in advance (S112a). Thereafter, the display control unit performs display screen movement processing, that is, display screen update processing, by the calculated scroll movement amount (S113a). By doing so, the display screen scrolling process (S102)
Can be reached.

[0279] In the updating process of the display screen related to the scrolling process, if the amount X moved in the horizontal direction by scrolling is smaller than the horizontal size X1 of the display screen, it is necessary to update. No old data display area X1
For -X minutes, the state is held once and the display image is left,
It is preferable to perform an update process in which only a newly displayed area X is added. This makes it possible to improve the processing speed during scrolling.

If it is determined in step S110 that the rotation has been made in the right direction, as shown in steps S111b to S113b,
Processing similar to a to S113a is performed. In S112b, the rotation amount-scroll movement amount conversion table is provided exclusively for the left rotation, but may be used for the right rotation.

Then, display processing relating to scroll processing is performed (S102). After that, the cursor button 301A
It is checked whether or not the rotation has stopped (S103), and the B process is performed (S104).

The cursor button 301A of the operation unit of this example
In addition to scrolling the display screen by rotating,
It is also possible to perform a process of enlarging or reducing the display area by a push-up or push-down operation, and a process of moving a black bar (cursor) in the vertical direction. Therefore, the following B processing can also be performed.

In the B process of S104, as shown in FIG. 32C, when there is a pressing operation or a pressing operation of the cursor button 301A (S120), it is determined whether the pressing operation or the pressing operation has been performed. (S121). If there is no operation, the B processing ends. If a push-up operation has been performed, display processing for enlarging the lower display area is performed (S122). When it is detected that a pressing operation has been performed (S123), display processing for enlarging the upper display area is performed (S124). Then, when ending the enlarged display, the B processing is ended, and when continuing the enlarged display processing, the steps from S121 are repeated (S12).
5).

As described above, in the second embodiment, the display data created or received can be organized and managed on the display screen on the time axis at that time. Thus, it is possible to easily search using time as a key without taking a complicated hierarchical structure.

Further, by intentionally moving data on a certain time axis, it can be used as a list or a schedule. Further, since the time axis moves with the passage of time, the relative time position relationship between the present and the target event, event, or the like can be easily understood.

Further, since the expression of the time axis, the past and the future can be identified by the display color (or black and white reversal), the current position is expressed by the boundary between different display colors. As a result, at the time of display, the quadrants can be seen at a glance such as past, future, and present.

The time scale adjustment (zoom) and each digit of the time axis (hierarchy of month, week, day, time, etc.) can be zoomed for each hierarchy. Display contents can be scaled in conjunction with the time scale. Zoom scale (5 hours, 12
Time, weekly schedule), and automatically change the data display range.

When the scale of the time axis is enlarged or reduced, fine data accompanying each schedule or the like can be seen (enlarged).
Invisible or reduced. Even if the size is reduced, only the volume of the scheduling is displayed in terms of area, so that the degree of clogging can be easily understood.

In the above example, the control relationship between the rotation input unit and the scroll is achieved by preparing a table in which the screen moves by several centimeters when rotated three times. And the storage unit stores a rotation angle-lateral movement conversion table defining the correspondence between the rotation angle and the lateral movement amount, and the CPU functions as a rotation angle-lateral movement amount conversion control unit. You may.

[Third Embodiment] Next, a third embodiment of the display device according to the present invention will be described with reference to FIGS. The same components as those in the first and second embodiments are denoted by the same reference numerals, and detailed description thereof will be omitted. In this example, the configuration of the display screen is configured as shown in FIGS. 36A and 36B.

[0291] In the figure, the portable device 500 of the present example comprises:
Crown 501A which is a rotation input unit as operation unit 501
And zoom-in button 5 above crown 501A
01B, zoom out button 50 below crown
1C, function button 501 below the display unit
D, a record button 501E is formed.

The crown 501A is configured to perform two operations: a rotation operation for rotating in the direction of the arrow R or S in FIG. 36A, and a pressing operation for pushing and pulling in the T direction. By this rotation operation, the vertical direction of the cursor (U,
When the cursor is moved to the upper or lower end of the screen by performing the movement of V), the screen can be scrolled upward (U) or downward (V).

The zoom-in button 501B is used to switch the mode among the 5-hour mode, 12-hour mode, 1-week mode, 1-month mode, and 1-year mode in the schedule display mode. The button 501C is operated. The zoom-in button 501C is used to select an icon and display a lower menu screen. By pressing the zoom-in button 501B and the zoom-out button 501C at the same time, it is possible to return to the five-hour / day schedule display mode for displaying the current time on any screen.

In the one week mode of the schedule display mode, the electronic mail icon 560 and the voice memo icon 5
50 is only placed on the time axis, and the details of the schedule are not displayed. Therefore, for example, to search for a time slot of a schedule in which a desired schedule is input, first, FIG.
As in 6D, in the one-month mode of the schedule display mode, the cursor is set to the week in which the user wants to zoom in, and the zoom-in button 501B enlarges the cursor. Similarly, as shown in FIG. 36C, it is possible to select a day on which the user wants to zoom in in the one-week mode of the schedule display mode and search for a desired scheduled portion.

Referring to FIG. 33B, in the schedule display mode 510 as a main screen, the display is divided into a scheduled date display area 512, a time axis display area 520, a schedule display area 530, and a current time display area 516 from the left. As for the time axis and the schedule, the upper part of the screen indicates the future, the lower part of the screen indicates the past, the boundary indicates the current time, and the background screen below the boundary is colored in, for example, gray.

Below the display section 503, a voice memo icon 550 and an e-mail icon 560 stacked and displayed are displayed.
Are formed above the display unit 503, the Todo icons 536A to 536D and the schedule display area 530 are displayed.
A schedule icon 534 is formed.

[0297] The Todo icon 536 is displayed side by side at the top right of the screen indicating the future because it is a matter to be done. The size of the Todo icon 536 indicates the importance and urgency of each item. These icons are arranged from left to right.

As a feature of the display screen in this case, as the time to complete is approaching, icon information such as schedule icon 534 shown in FIG. 33B, TO-DO
The display of the list icon 536A and the like becomes larger. Also,
The voice memo icon 550A is displayed large when the recording time is long.
You can remember the contents.

Also, the e-mail icons 560 are stacked and displayed so as to include a superimposed area, and the same type of icons are superimposed on each other from the bottom while being shifted, thereby enabling a large number of displays. As a result, the number of incoming mails and the like can be visually understood roughly according to the degree of stacking of blocks and the like. It should be noted that the number of the laminations is increased when the number exceeds a certain number.

When the window is opened by selecting the Todo icon 536, a display screen as shown in FIG. 39A is displayed. Push and pull crown 501A, "DONE" 538
A, select "NOTYET" 538B and click the zoom-in button 5
Select with 01B. When the DONE tab 538A is selected, a check mark 589 as shown in FIG. 39B is displayed, and a means for displaying a window (dialog) so as to explode is provided.
Gives a sense of accomplishment of completing do.

[0301] The voice memo icons 550 are displayed side by side at the lower right of the screen representing the past because they have already been created.

[0302] By operating the zoom-in button 501B,
When the window is opened by selecting the voice memo icon 550, as shown in FIG. 40A, a bar graph showing the date, time, and recording time when the memo was created (recorded) is displayed above. By looking at these, the user can remind the memo without playing it.

In the lower part, “discard” 552A, “regeneration” 5
52B, “move to time axis” 552C, the processing for this memo is displayed by icons.

The desired icon is inverted by pushing and pulling the crown 501A, and the processing is selected by the zoom-in button 501B having a select function. When no processing is performed, a zoom-out button 501 having a cancel function is provided.
Press C to close the window.

When “move to time axis” 552C is selected,
The voice memo icon 550A is captured by the cursor and flashes. Rotate crown 501A, move the icon by dragging at the desired time,
Press to paste on the time axis.

Here, when the zoom-in button 501B is pressed, a window is displayed, the time and date to be set are confirmed, the notification means such as the alarm tone, beep sound, vibration, etc. is selected, and the voice memo icon 550C is displayed on the schedule. (FIG. 40B).

[0307] This notifying means includes a first notifying unit for making a notification according to the situation of the user, a second notifying unit for making a notification according to the content of the information, and a notification according to the importance to be notified and the degree of urgency. And a third notification unit for performing the switching. For example, sleeping, modestly blinking, not annoying during a meeting, rather than sounding, notifying you of incoming mail by vibration, notifying you of incoming calls by the user's name, etc. In addition, as other notification means, a timbre change unit, a voice change unit, a vibration generation unit, an odor generation unit, a light generation unit, an electric generation unit that performs an electric shock, and the like, which are notified by a timbre, may be mentioned.

When recording a voice memo, pressing the record button 501E opens a window as shown in FIG. 42A and enters a recording standby mode. In this state, the user can perform recording. When the voice is recognized, as shown in FIG. 42B, the “RECORD” screen 622 flashes, indicating that recording is in progress, and the elapsed recording time is displayed as a bar. When the user stops talking, the recording automatically ends, and a window 624 for the next lower menu opens.

In this window 624, as shown in FIG. 42C, the recording date, time, and recording time are displayed.
The processing of “erase” 626C, “playback” 626B, and “move to time axis” 626A is selected by pushing / pulling crown 501A and operating zoom-in button 501B. Pressing the zoom-out button 501C returns to the schedule display screen.

[0310] When an e-mail arrives at the desktop, notebook PC, or server, the portable device 2 is notified of the information. Specifically, as shown in FIG. 41A, an e-mail icon 560 automatically appears at the position of the current time and flashes. By operating the zoom-in button 501B, “URGENT” 561B and “RSV.
P. A window 561 of a lower menu having a title of a mail type such as "" is displayed. In the window 561, a photograph 561A of the sender's face and a summary 561C of the message content are displayed.

[0311] In this state, the zoom-in button 50
When 1B is pressed, a lower menu screen 562 shown in FIG. 41B is displayed.
Is displayed, and the reception time, date, and the name of the caller are displayed above the window 562. With the icons below, the process “opened” 563B and “move to time axis” 563A for this mail are selected. With “move to time axis”, it is possible to notify when the time has come.

[0312] These various icons can be incorporated into the schedule over time by freely pasting them on the time axis. For example, in the example of FIG. 40C, a voice memo icon 550B is also placed beside the time axis.

Furthermore, in this example, the voice memo icon 5
50, the e-mail icon 560 is placed on the time axis such as the input time and the arrival time, but those that are older than the displayed time are collected below the schedule display area and displayed on the screen. It has a catch net metaphor function.

FIG. 38 shows a state of the sleep mode which is an initial screen after the power is turned on. In the sleep mode, a lower area for displaying the current time 518 is enlarged and covers the screen like an eyelid. An indication of the battery level is added to this part. Incidentally, even if this part is completely closed, the schedule display area is set to, for example, 2.
You may comprise so that it may display only the scale of time. In the latter case, the schedule can be confirmed without going to the main screen. By forming such a sleep mode, the screen becomes dark, and it is possible to prevent the contents of the schedule from being easily seen by others. The schedule display area darkens out for security. However, various icons can be displayed, and the presence or absence of a schedule can be checked. The bar graph at the right end indicates the charge level.

By operating any switch like a screen saver, the mode is switched to the schedule display mode shown in FIG. 36B. If there is no operation on the operation unit for a predetermined time, the operation returns to the sleep mode again.

(Scroll) As shown in FIG. 38, the crown is rotated to scroll the screen. here,
The rotation of the crown matches the speed of the scroll.

Here, in order to perform the scroll process, first, as shown in FIG. 43A, the crown is rotated (S1).
30), the rotation direction is determined by the process A (S131).

That is, in the process A of S131, first, it is determined whether the rotation direction is upward rotation or downward rotation (S140). Next, in the case of rotation in the upward direction, the amount of rotation corresponding to the upward rotation, such as the rotation angle and the number of rotations, is detected (S141).
a). Next, the scroll movement amount on the display screen with respect to the detected rotation amount is calculated using a rotation amount-scroll movement amount conversion table prepared in advance in a storage unit or the like (S142a). Thereafter, the display control unit performs display screen movement processing, that is, display screen update processing, by the calculated scroll movement amount (S143a). By doing so, the display screen scrolling process (S132)
Can be reached.

[0319] In the update processing of the display screen related to the scroll processing, if the amount Y moved upward by scrolling is smaller than the vertical size Y1 of the display screen, it is necessary to update the display screen. No old data display area Y1
For -Y minutes, the state is held once and the display image is left,
It is preferable to perform an update process in which only the newly displayed area Y is added. This makes it possible to improve the processing speed during scrolling. Also, S
If it is determined in step 140 that the camera has been rotated downward,
As shown in 143b, the same processing as in S141a to S143a is performed. In S142b, the rotation amount-scroll movement amount conversion table is provided exclusively for lower rotation, but may be used for upper rotation.

Then, display processing relating to scroll processing is performed (S132). Thereafter, it is checked whether the rotation of the crown 501A has stopped (S133), and the B process is performed (S134).

The crown 501A of the operation unit of this embodiment can perform not only the scroll processing of the display screen by the rotation operation but also the movement processing of the cursor in the left and right direction by the push-pull or the push operation. Therefore, the following B processing can also be performed.

In the B process of S134, as shown in FIG. 43C, it is determined whether there is a push-pull or push-out operation of the crown 501A (S150). If there is no operation,
The B process ends. If there is an operation, crown 5
The movement amount of 01A is detected (S151). Next, the movement amount of the cursor is calculated from the movement amount of the crown 501A using a correspondence table or the like (S152). by this,
A cursor movement process is performed (S153). Thereafter, for example, various display processes such as clicking and dragging are performed by the cursor (S154), and it is determined whether further movement of the cursor is necessary (S155). In S155, if it is necessary to move, the processing is repeated from S150 and S1.
If there is no need to move at 55, the B processing is terminated.

By the way, at the time of scrolling, FIG.
As shown at ~ 36D, the schedule scale is 5
You can switch between hours, 12 hours, 1 week, and 1 month. For this reason, the balance of the area of the date, time axis, and schedule display, especially the width of the time axis (width of the time axis display area 520) is reduced to G1, G2, G3, and G4 depending on the size of the scale. The width of 522 is H1 → H2
And the scheduled date display area 512 changes from F1 to F2 to F
Since the scale is expanded from 3 to F4, the scale of time can be easily grasped visually. The title in the schedule also changes the number of display fonts and font size according to the scale.

When the first information of the lower hierarchy of the item in the schedule has related information such as an address stored in the portable device, the first information is automatically recognized and related to the first information. The information is associated with the title of the related information is displayed in the item column of the schedule.

(Database) Function Button 5
When 01D is selected, the mode is switched to the database mode, and a database menu screen 572 is displayed as shown in FIG. 37A. This database menu screen 5
There are five categories “PEOPLE” 572A, “OF
FICE ”572B,“ PROJECT ”572C,“ SYNCHRONIZ
E ”572D and“ PREFERENCE ”572E are displayed, and the desired category is highlighted by rotating crown 501A (“ OFFICE ”572 in the example of FIG. 37A).
B), pull the crown 501A to select and move to a lower hierarchy. Then, as shown in FIG. 37B, an initial selection screen 584 that displays a list of names in alphabetical order, which is a hierarchy lower than the right side of the screen, appears, and a menu selection area 582 that displays the category of the upper hierarchy is packed to the left. .

Further, on the initial selection screen 584, the desired initial is reversed by rotating the crown 501A ("G" in the example of FIG. 37B), and the crown 501A is selected by pulling the crown to move to a lower hierarchy. I do.

Here, in order to generate a display screen as shown in FIG. 37B, the following method is preferable. That is, in general, the area where the cursor can move is a meaningful screen, and the area where the cursor cannot move is a meaningless screen. Therefore, in FIG. 37B, the screen other than the initial selection area 584 is displayed as a background screen. The initial selection area 584 is sequentially updated in accordance with the scroll of the operation unit. When the crown is rotated to A, B, C, D,..., G appears or H appears. Then, characters are displayed only at the position of G.

[0328] Then, for example, the screen after G is selected is completely updated to another display screen whose width is narrowed to the left as shown in FIG. 37C. Here, other areas are rewritten without rewriting the menu selection area 582. Note that, by adopting a configuration in which data is arranged in order according to the hierarchical structure in advance, a step of re-sorting and extracting randomly included data every time a search is performed can be omitted, and control is simplified. Therefore, it is preferable that the data has a structure in which all data are arranged in alphabetical order.

In the hierarchy shown in FIG. 37C, a name selection screen 590 displaying a list of names in alphabetical order is displayed. In the name selection screen 590, the menu selection area 582 and the initial selection area 584 are further packed to the left. On the name selection screen 590, a desired name is highlighted by rotating the crown 501A, and the name is selected by pulling the crown 501A. Then, as shown in FIG. 37D, the personal data display screen 600 of the lowest hierarchy is displayed.

In the personal data display screen 600, a menu selection area 582, an initial selection area 58
4 and the name selection area 596 are further padded to the left. In the personal data display area 608 of the personal data display screen 600, a face photograph 610, a name 612A, a telephone number 612B, and an address 612C are displayed.

In this example, the category “PEOPLE” 5
72A is a menu screen 572 → initial selection screen 5
80 → Name selection screen 590 → Personal data display screen 600
It has a hierarchy.

[0332] Then, the lower layers appear in order from the right side of the screen. That is, as shown in FIG. 37B to FIG. 37D, the width of the menu selection area 582 becomes narrower as moving to lower layers such as L1 → L2 → L3, and the width of the initial selection area 584 also becomes lower as M1 → M2 → M3. It is configured so that the width becomes narrower as it moves to the hierarchy. In this way, the layers of the data are arranged horizontally, and the items in the layers are arranged vertically. Movement between layers is performed by pushing and pulling the crown 501A, and selection in the same layer is performed by rotating the crown 501A. To do.

[0333] Therefore, regardless of the hierarchical level, all hierarchical levels higher than the currently displayed hierarchical level are displayed on a single screen, so that the hierarchical structure of data can be easily understood and data can be moved to other hierarchical levels. Easier to do. In addition, an easy-to-understand interface is realized by setting the direction of the hierarchical structure of the data and the operation direction of the hierarchy selection to be the same direction and making the operation direction to be selected unambiguous.

In the above example, the control relationship between the rotation input unit and the scroll is achieved by preparing a table such that the screen moves by several centimeters when rotated three times. A rotation angle-vertical movement conversion table defining the correspondence between the rotation angle and the vertical movement amount by connecting the movement amount detection means, the rotation angular velocity detection means, and the like to the CPU;
Crown left-right movement-cursor movement conversion table that defines the correspondence between the right or left movement of the crown and the cursor movement, rotation angular velocity-enlargement that defines the correspondence between the crown rotation angular velocity and the degree of scaling. The reduction degree conversion table is stored in the storage unit, and the CPU functions as a rotation angle / vertical movement amount conversion control unit, a crown movement amount / cursor movement amount conversion control unit, and a rotation angular speed / enlargement / reduction fluctuation amount conversion control unit. You may comprise.

For example, as the degree of importance and the degree of urgency increase, the size of the icon also increases. It also increases as the time to complete it approaches. Furthermore, the voice memo and the recording time become longer as the recording time becomes longer, and the user can remember the contents only by the size of the icon.

[Fourth Embodiment] Next, a fourth embodiment of the display device according to the present invention will be described with reference to FIGS. The same components as those in the first, second, and third embodiments are denoted by the same reference numerals, and a detailed description thereof will be omitted. In this example, the configuration of the display screen is configured as shown in FIG.

The portable device 700 of this example is constituted by a card-type portable device by pen input that enables so-called handwritten input. Therefore, unlike the first to third embodiments, the hardware configuration has a pen input operation unit in addition to the configuration of the block diagram shown in FIG.
Further, the CPU has a recognizing means for recognizing pen input characters, figures, and the like, and performs various processes based on the recognition results. The storage unit includes, in addition to the above-described RAM and ROM, a non-volatile memory card that is detachable from a portable device, a PCMC.
An IA card, an ID card dedicated to the portable device, and the like are included. It is also possible to input text data using the operation unit.

The display unit has an active matrix type liquid crystal display panel having both an image display function and an electrostatic induction tablet function, and a tip coordinate of the pen input operation unit on the display panel in response to a signal from the pen input operation unit. And a control circuit for controlling the image display operation and the coordinate detection operation.

The pen input operation unit has a region detection electrode having a high input impedance coupled to a row electrode and a column electrode on the display panel by a stray capacitance at its tip, and has a scanning pulse or a column applied to the row electrode. An induced voltage is induced in the detection electrode due to the scanning pulse applied to the electrode. The coordinate detection circuit detects the timing of generation of an induced voltage generated at the detection electrode of the pen input operation unit based on the coordinate detection timing signal from the control circuit, and detects the tip coordinates.

There is provided an instruction judging means for judging the contents of the processing menu instructed by the pen input operation unit among the menus displayed on the display unit, and a function for executing a process according to the judgment result, And a function for performing various processes based on the recognition result.

When the pen input operation unit and the portable device are not connected by a cable, the pen input operation unit includes an information collection unit, a code information generation unit, a temporary storage unit, a position detection unit, and a user. A signal generating code information transmitting unit for transmitting code information and a position indicating signal is formed based on the operation instruction, and a single pen-shaped coordinate indicator enables a handwriting input and a barcode input to be displayed. It is preferable that the configuration of the unit includes a sense matrix unit, a position detection unit (designated coordinate sensing unit), a code information extraction unit, and a position detection processing unit.

Therefore, the portable device 700 of this example has a pen input operation unit 703 and operation buttons 0 to 9 as the operation unit 702.
have.

FIG. 44 shows a layout of a screen configuration of the main screen. As shown in the figure, the display unit 706 includes a date display area 710 for displaying the current time and date at the top of the display unit 706, an e-mail display area 720,
It has a schedule display area 730 and a database display area 740.

In the date display area 710, the date is displayed as “AM”.
10:05 59 Thursday Oct. 12 "701. The e-mail display area 720 is located on the time axis far from the image where the e-mail arrives from a distance, and includes the sender's mailbox icon 721 and its number, the transmission waiting mailbox icon 722 and its number, and the reception mailbox icon. 723 and its number,
Opened mailbox icon 724 and its number,
Is displayed.

The schedule display area 730 is based on the time axis display area 733 with perspective according to the landscape metaphor, and has a schedule in the right area in the form of building icons 736 and 737, and a TO area in the left area.
The DO list is displayed in the form of a billboard 738.

[0346] The time axis of the time axis display area 733 indicates the future as the near side is closer to the present and the farther away. In this way, the time axis is arranged in a road shape viewed from above, and the GUI of the object placed around the road is represented by an image.
Set. In this example, for example, a road is set as a time axis, a building is set as a schedule, a signboard is set as TODO, and a manhole is set as a memo. Further, along with the time axis display area 733, a schedule presence / absence background display area 734 for coloring and displaying a scheduled area is formed, and a background screen coloring display area 732 for coloring and displaying a past area around the current time is provided. Has formed.

[0347] The time axis on the road has a sense of perspective, objects far away (future) are small, and as the present time gradually approaches the time, the objects become clearly visible, and rough contents can be identified.

[0348] The schedule is displayed in the form of a building on the right side of the road, the TODO list is displayed in the form of a billboard in the left area, and the direction to which the user is facing is displayed by using the direction change icons 744 and 745 as view change buttons. Move to each function mode shown.

The building icons 736 and 737 are a plurality of types of three-dimensional animated icons having different shapes and attributes. These types of buildings represent the types of schedules, and the meanings of the schedules are different. In this example, the building 736 is an official schedule, a general house 737
Means private appointment.

The signboard icon (billboard) 738 is fixed at a certain point (time) on the road, and has a legged signboard icon 738A indicating data related to time, and is displayed floating in the space. And a signboard icon 738B with no foot indicating unrelated data. In the past area on the time axis display area 733, a manhole icon 739 for writing a memo is provided. Also,
The part representing the past on the time axis is darkened out so that the present point can be easily recognized.

Further, by scrolling, the scale of viewing the schedule (one day / one week) is given a perspective on the road, and the distant ones are compressed and displayed as a bird's eye view. That is, as the scale of the time axis is increased by scrolling and the screen is reduced and displayed, the viewpoint position of the three-dimensional display is gradually increased, so that when the image is reduced, it is viewed from above like a bird's-eye view as shown in FIG. 46A. An image display screen, a bird's eye view display mode 850 is generated. In this case, the time axis display area 852 is a time axis on a daily basis, and the schedule display area 85
4 are variously small icons. The length of the various icons formed in the direction orthogonal to the time axis indicates the degree of clogging of the day.

Here, in order to generate such a display screen, each type of building is changed according to information by holding a character and changing a bitmap according to time. If you do not finely control the road,
Rewrite with numbers.

The bird's eye view is displayed by determining the position of each icon based on the start time information of the head of the schedule and the information on the length, selecting a character from among several types according to the length, and selecting the time axis. It is preferable to stick on top.

In this case, for example, if there are many characters in sufficient units, the processing is difficult, so it is preferable to limit the types. For example, in the case of a cubic character of a building icon, only the right side and the left side of the cube have a picture, and a line connects the right end and the left end with a line based on the start time and end time. It is preferable to adopt a forming method for forming only a shadow of data.

The database display area 740 below the display unit 706 is a database owned by the user, and includes a telephone directory icon 741, an icon 743 for scrolling in the future direction on the time axis, and an icon 743 for scrolling in the past. An icon 742, a direction change icon 744 for turning to a two-dimensional display in which the building icon 736 faces the front, and a direction changing icon for turning to a two-dimensional display in which the billboard icon 738 faces the front. 745.

The scale switching button 70 on the side of the card
4A, 704B, and 704C enable switching from the top to monthly, weekly, and daily units. The daily unit is
The position close to the ground, the weekly unit corresponds to the height of the bird's eye, and the monthly unit corresponds to the position seen from the satellite, which is an image of zooming up the city.

FIG. 51D shows a display 840 on a monthly basis. In the monthly display, unlike the daily and weekly displays, the upper part of the display unit is near the present, and the lower part of the display unit is for the future. This bar graph represents the total amount scheduled for the day.

Then, as shown in FIG. 51E, the time axis is scrolled by continuing to touch the scroll icon, and the scroll stops when the pen is released.

In FIG. 51F, for example, an area 844 on November 14 is double-touched. Then, the time is switched to the time axis on a day-by-day basis. As shown in FIG. 50A,
Further, when the building 736 is double-touched, the contents of the schedule are displayed as shown in FIG. 50B. Here, in order to change the schedule from November 14, the building on the time axis is dragged to a desired time position with a pen, as shown in FIG. 50C.

As shown in FIG. 51A, the mail is opened from the received mails by double-touching the received mail displayed in the list. In this window, a list of caller names and titles is displayed. When the user double-touches a desired mail, a window of a lower menu as shown in FIG. 51B is displayed.

Here, as shown in FIG. 51C, when the time display area at the top of the display section is touched, the display returns to the time axis display mode of the current time.

In the case of simply closing, the user double-touches the upper left close box to close it.

As shown in FIG. 50D, by touching the pen input operation unit 703 to an arbitrary key on the keyboard,
A memo input screen in the memo mode as shown in FIG. 50E opens. Among the various icons (at the title bar of the memo screen) located at the top of the memo input screen window in FIG. 50E, the schedule input format selection icon 786 is selected by the pen input operation unit 703 and double-touched. .

Then, a schedule display screen 790 as shown in FIG. 50F is displayed. In the schedule display screen 790, the time is set by tracing the scale in the screen with the pen input operation unit 703. When a name is entered, if there is related data in the database, an icon indicating the data is displayed after the name.

[0365] The presence / absence of an alarm is set by an alarm presence / absence icon 796. Further, the type of the building is selected from any of the building icons 794A to 794D by touching.

When the input screen for inputting the schedule is closed, as shown in FIG. 49A, a building icon 736 indicating the schedule is automatically pasted on the time axis.

Next, when creating an e-mail, a memo input screen 780 in the memo mode is opened as shown in FIG. 49B. Among the various icons (at the title bar of the memo screen) located at the top of the memo input screen 780 window in FIG. 49B, the mail input format selection icon 782 is selected by the pen input operation unit 703 and double-touched. I do.

Then, an e-mail display screen 800 as shown in FIG. 49C is displayed. In this e-mail display screen 800, input is performed using a keyboard.
When the name is entered, the e-mail address is automatically retrieved from the database and displayed on the e-mail display screen 800. When an e-mail is created by using the keyboard, the pen input operation unit 703 touches the close box icon 802 located at the left end of the title bar at the top of the window of the e-mail display screen 800, and the e-mail display screen 800 is displayed. Can be closed.

Then, when an e-mail is created and closed,
The e-mail is sent to the mailbox icon 7
22 and automatically transmitted when the card included in the portable device is connected to a telephone line.

Next, in order to create an item (to-do list) that needs to be done in the future, the pen input operation unit 703 is touched to the keyboard as shown in FIG. 49D. Then, a memo input screen 780 in the memo mode is opened as shown in FIG. 49E. Among the various icons (in the title bar of the memo screen) located at the top of the memo input screen 780 window in FIG.
Click the input format selection icon 784 for the O list.
A selection is made with the pen input operation unit 703 and a double touch is performed. When the reply button is touched, the screen is switched to a reply mail creation screen.

Then, Todo as shown in FIG.
A list display screen 810 is displayed. In the hand light area 812 in the Todo list display screen 810,
Using the pen input operation unit 703, characters are input as ink data by handwriting.

In FIG. 49F, “BUY WIN”
"E" is handwritten. In this case, the displayed characters are not Mincho, Gothic, etc., but handwritten characters are displayed using font data for handwriting.
Although not shown, when text data is input using a keyboard, font data such as Mincho and Gothic fonts are displayed in the hand light area 812.

When a character is entered in hand light area 812, this area is pasted and displayed on the time axis in its original form.

[0374] The TODO list includes a Todo list on the time axis and a Todo list on the time axis.
There is a list. When a time is designated, a billboard icon with a foot is pasted on the time axis as a Todo list on the time axis. Those that do not ride on the time axis float in any place on the time axis in the form of a billboard without legs.

Normally, the billboard icon disappears from the screen as time passes. However, Tod on the time axis
If the o-list has not been erased, the billboard icon remains at the bottom until the erase operation is performed, regardless of the lapse of time. Here, when several billboard icons accumulate on the lower side, the icons are alternately displayed in a stacked manner.

When the billboard icon 738B is to be deleted, as shown in FIG. 48A, if a check is made with the pen input operation unit 703, the Todo is automatically performed.
The billboard icon 738B representing the list will be deleted.

Next, when searching the database, as shown in FIG. 48B, when the database box icon 741 is double-touched by the pen input operation unit 703, the mode shifts to the search database display mode.

As shown in FIG. 48C, the search mode screen 7
At 50, a search word, for example, the initials of the name, for example, ya is input to the search word input tab 752 using a keyboard, and the binoculars icon 754 is touched with the pen input operation unit 703 to start the search. After the search, the corresponding data can be displayed.

Then, as shown in FIG. 48D, the corresponding data is displayed in a list on the relevant data list display screen 760. By double-touching the selection tab 762 of desired data from the relevant data by the pen input operation unit 703, detailed data can be displayed on the data display screen 770 as shown in FIG. 48E.

Next, when creating a memo, refer to FIG.
As shown in the figure, the pen input operation unit 703 is touched on the keyboard. Then, as shown in FIG. 47A, a memo input screen 780 in the memo mode is opened. Using the pen input operation unit 703 in the memo input screen 780 of FIG.
Character input is performed as ink data by handwriting.

In FIG. 47A, “TAXI ¥ 12
"0" is input by handwriting. In this case, the display characters are not Mincho, Gothic, etc., but handwritten characters are displayed using font data for handwriting.
Although not shown, when text data is input using a keyboard, the memo input screen 780 includes
Font data such as Mincho and Gothic fonts will be displayed.

When the close box icon is touched by the pen input operation unit, the memo input screen 780 is closed, and as shown in FIG. 47B, the memo is displayed in the form of a manhole icon 739 on the time axis on which the memo was created.
Conversely, when the manhole icon 739 is double-touched, a memo content display screen is displayed.

[Embodiment 5] Next, Embodiment 5 of the display device according to the present invention will be described with reference to FIGS. The same components as those in the first, second, and third embodiments are denoted by the same reference numerals, and a detailed description thereof will be omitted. In this example, the configuration of the display screen is configured as shown in FIG. 55C.

In FIG. 52A, the display screen 1000 on the PC side is displayed.
A display screen 1002 currently displayed on the portable device is displayed as a window inside the window. Then, in the display screen of the PC, for example, access to another server on the Internet to display a document, a photograph, a description, and the like can be performed, and the display image can be captured in the storage unit of the portable device. . In this case, a camera tool is selected by a tool such as software (PIM software) related to the present display device on the PC, and a range of a target image is specified to select a portion to be captured. Thereafter, the image is captured in a memo in the memo mode of the display device.

Further, as shown in FIG. 52B, the image can be taken into a to-do list in the to-do list mode.

Since the PC and the portable device can perform data synchronization of only information specified in advance, the PIM
The mobile device can be synchronized with the software itself, notes on the PIM, downloaded e-mail, and the like. Therefore, the image currently captured on the display screen on the PC is simultaneously data-synchronized with the portable device. Therefore, even if the user carries only this portable device, the PIM software itself, the memo on the PIM, downloaded e-mail, and the like can be handled similarly to the PC.

FIG. 52C shows the details of the display screen on the portable device side. In the figure, unlike the above-described fourth embodiment,
The time axis 1112 of the date is represented as a metaphor of the sign on the road. Embodiment 4 is different from Embodiment 4 in that the magnitude of the schedule is indicated by the height of the building icon.

In FIG. 54A, in the mode after the direction change, the image captured in the Todo list is displayed on the signboard 111.
8 is displayed. Thus, the captured image can be used as character data of the icon for the TODO list.

In FIG. 54C, when information notification is set in advance, audio information such as a melody is output from the audio output unit of the portable device at a desired time, and a schedule as shown in FIG. Pop-up menu 1 indicating
Reference numeral 142 denotes an example in which a schedule is displayed adjacent to the building icon 1140 in which the schedule is input. in this way,
At the time of information notification, the user can be notified using both the voice information and the display information.

FIG. 54B shows a display screen when a schedule is written in the TODO list. In FIG.
The mode of the ODO list 1110 is opened, and the character input interface 11 represented by the display image of the keyboard is displayed.
By opening the window 30 and selecting various keyboard tabs on the character input interface 1130 with the pen input operation unit or a finger, the TODO list 111 is displayed.
Writing of characters and the like to 0 is performed.

In FIG. 55A, note display mode 1150
It is shown. Also in this node display mode, the order of various items can be changed, or new items can be added. The order of the items can be changed, for example, by touching with a finger or touching a pen input operation unit. Even when a new item is added, pen input can be performed using a finger or a pen input operation unit by using the character input interface 1130 displayed on the screen by a keyboard.

In FIG. 55B, a balloon icon 1116 is displayed.
Is displayed. When the balloon icon 1116 is touched, an e-mail is opened and a lower display screen mode in which specific contents are displayed can be displayed. This is shown in FIG. 55C. Also on the e-mail display screen 1120 of FIG. 55C, by using the character input interface 1130, a mail for reply can be created and edited.

Further, the created mail can be transmitted to a desired destination. When performing this transmission, first, the card according to the present portable device is attached to a docking station having a built-in modem, an extended battery, and the like, and connected to a telephone. Then, as shown in FIG. 53A, a balloon icon 1 representing an electronic mail on the screen is displayed.
By moving 116 over the post icon 1114, transmission becomes possible. After that, it is automatically connected to the telephone line, and when the mail has been sent, the line is automatically disconnected.

FIG. 53B shows a screen on which a plurality of received mails are displayed as balloon icons 1116 so as to float on the road.

FIG. 53C shows an example in which an e-mail display screen 1120 showing the specific contents of the e-mail is displayed after clicking any of the balloon icons 1116. In the figure, in the case of an e-mail with a schedule attached, an icon 1122 for confirming the schedule is displayed on the e-mail display screen 1120. When this icon 1122 is selected, the schedule display mode of the target date and time is displayed as a further lower menu screen.

FIG. 53D shows a case where a schedule is attached to an electronic mail and transmitted. When the schedule OK button is clicked, the items of the schedule are automatically registered, and at the same time, a screen of a reply e-mail opens. Then, transmission can be performed by clicking the post icon 1114.

It should be noted that while the apparatus and method according to the present invention have been described in accordance with certain specific embodiments thereof, those skilled in the art will recognize that they have been described herein without departing from the spirit and scope of the invention. Various modifications can be made to the embodiment. For example, as shown in the conceptual diagrams of FIGS.
It may be used in a network as shown in each figure of 56C. That is, a network may be configured so that the PC 1 and the portable devices 2-1, 2-2,... Can communicate with each other.

In this embodiment, the case where the present invention is worn on an arm has been described as an example. However, the present invention is not limited to this, and can be used for various purposes as needed. Further, the keys of the portable device of the above embodiment are not limited to the arrangement, but may be other numbers as needed.

Although the case where an LCD display is used as the display unit has been described, the present invention is not limited to this. The device can be used. Further, in the present invention, the image projected on the display unit does not necessarily need to be a three-dimensional image.

Further, when the icon character data can be changed from a pigeon to an animal on the display unit of the PC, for example, the icon character data is displayed as an animal on the display unit of the portable device.
May be synchronized. In this case, the PC may download the icon information of the view corresponding to the animal together with the normal information to the portable device.

Note that PC1 is further connected to an Internet line,
The mobile device 2 is connected to another server on the Internet via a LAN, WAN, intranet line, or the like.
May be configured to allow access to other servers or the like via the Internet via the PC 1 or to allow the portable device 2 and other portable devices to enjoy information via the PC 1. May be.

Also, an example has been described in which a PC is used as the second information processing apparatus and the display device of the present invention is applied as the first information processing apparatus.
C, a server, or the like may be used. Although a PC is used as the second information processing apparatus, a workstation,
It may be a mainframe, a word processor, or the like.

Further, the device constituting the display screen shown in the fourth and fifth embodiments may have a structure in which an arm mounting portion is formed.

[Brief description of the drawings]

FIG. 1 is a schematic view of a display screen showing an example of an embodiment of a display device according to the present invention.

FIG. 2 is a schematic diagram showing an example of a lower menu screen (window) displayed when an icon on the display screen of FIG. 1 is clicked.

FIG. 3 is a schematic diagram showing an example of a lower menu screen (window) displayed when an icon on the display screen of FIG. 1 is clicked.

FIG. 4 is a perspective view showing an example of the portable information processing apparatus and a personal computer when a network is configured by the portable information processing apparatus and a personal computer according to the present invention and data synchronization is performed.

FIG. 5 is a block diagram illustrating a hardware configuration of each of the portable information processing apparatus and the personal computer of FIG. 4;

FIG. 6 is a front view showing a portable information processing device according to the present invention.

7 is a schematic diagram showing a main screen displayed on a display unit of the portable information processing device of FIG.

8 (A) to 8 (F) are schematic diagrams each showing an example of a lower menu screen shown in a lower menu of the main screen of FIG. 7;

FIGS. 9A to 9E are schematic diagrams illustrating an example of a screen displayed on a display unit of the portable information processing apparatus in FIG. 6;

FIG. 10 is a schematic explanatory view showing a higher-level menu group, a lower-level menu group, and a setting display screen displayed stepwise on a display unit according to a control system of the display device of the present example.

FIG. 11 is a functional block diagram showing a software configuration of the portable information processing device according to the present invention.

FIG. 12 is a functional block diagram showing a software configuration of the portable information processing device according to the present invention.

FIG. 13 is a functional block diagram showing details of the functional block diagram of FIG. 12;

FIG. 14 is a schematic diagram showing a memory map representing a hierarchy of information stored in a storage unit of the portable information processing device according to the present invention.

FIG. 15 is a conceptual diagram showing electromagnetic signals of data transmitted and received between a communication unit and other internal devices.

FIG. 16A is an explanatory diagram illustrating an example of a table that defines the relationship between character data stored in a storage unit of a portable information processing device and a function program related to the character. . FIG. 2B is an explanatory diagram showing an example of a table in which character data stored in a storage unit of the portable information processing device, an arrangement position on a screen, and a menu format are shown according to each mode.

FIG. 17A is an explanatory diagram showing an example of background screen character data stored in a storage unit of the portable information processing device. FIG. 2B is an explanatory diagram showing an example of icon character data stored in the storage unit of the portable information processing device.

FIG. 18 is a flowchart showing a control procedure performed by the control system.

FIG. 19 is a flowchart illustrating the processing A in the flowchart of FIG. 18 in further detail.

FIG. 20A is a flowchart illustrating step 3 of the flowchart of FIG. 18 in further detail; FIG. 17B is a flowchart illustrating step 3 of the flowchart of FIG. 18 in further detail.

FIG. 21A is a flowchart illustrating steps 32 and 42 of the flowcharts of FIGS. 20A and 20B in further detail. FIG. 20 (B) shows the state shown in FIG.
It is a flowchart explaining in detail an example in the case of performing steps 32 and 42 of the flowchart of FIG. FIG. 20C is a flowchart describing in detail an example in which steps 32 and 42 of the flowcharts of FIGS. 20A and 20B are performed.

FIG. 22 is a flowchart showing an operation procedure performed by the operation system.

FIG. 23A is a schematic diagram of a display screen showing an example of another embodiment of the display device according to the present invention. FIG. 23B is a schematic diagram of a display screen showing a main screen of the display device of FIG.

FIG. 24 shows a higher-level menu group displayed stepwise on the display unit in accordance with the control system of the display device shown in FIGS.
It is a schematic explanatory drawing which shows a lower menu group and a setting display screen.

FIGS. 25A to 25C are FIGS.
It is the schematic which shows an example of the screen displayed on the display part of the display device of (B).

FIGS. 26A and 26B are FIGS.
It is the schematic which shows an example of the screen displayed on the display part of the display device of (B).

FIGS. 27 (A) to (C) show FIGS.
It is the schematic which shows an example of the screen displayed on the display part of the display device of (B).

28 (A) to FIG. 28 (C) are FIGS.
It is the schematic which shows an example of the screen displayed on the display part of the display device of (B).

29 (A) to FIG. 29 (C) are FIGS.
It is the schematic which shows an example of the screen displayed on the display part of the display device of (B).

30A to FIG. 30C are FIGS.
It is the schematic which shows an example of the screen displayed on the display part of the display device of (B).

FIG. 31 is a schematic diagram showing an example of a screen displayed on the display unit of the display device in FIGS. 23 (A) and (B).

FIG. 32A is a flowchart showing an operation procedure performed by the operation system of the display device in FIGS. 23A and 23B. FIG. 32B is a flowchart illustrating step 101 of the flowchart in FIG. 32A in further detail. FIG. 29C is a flowchart illustrating step 104 of the flowchart of FIG.

FIG. 33A is a schematic diagram of a display screen showing an example of another embodiment of the display device according to the present invention. FIG. 33B is a schematic diagram of a display screen showing a main screen of the display device of FIG.

FIG. 34 shows a higher-level menu group displayed stepwise on the display unit according to the control system of the display device shown in FIGS. 33 (A) and (B).
It is a schematic explanatory drawing which shows a lower menu group and a setting display screen.

FIG. 35 is a schematic diagram showing an example of a screen displayed on the display unit of the display device in FIGS. 33 (A) and (B).

36 (A) to FIG. 36 (D) show FIGS.
It is the schematic which shows an example of the screen displayed on the display part of the display device of (B).

FIGS. 37 (A) to (D) show FIGS.
It is the schematic which shows an example of the screen displayed on the display part of the display device of (B).

FIG. 38 is a schematic diagram showing an example of a screen displayed on the display unit of the display device in FIGS. 33 (A) and (B).

39 (A) to FIG. 39 (D) are FIGS.
It is the schematic which shows an example of the screen displayed on the display part of the display device of (B).

40A to FIG. 40C are FIGS.
It is the schematic which shows an example of the screen displayed on the display part of the display device of (B).

41A and FIG. 41B are FIGS.
It is the schematic which shows an example of the screen displayed on the display part of the display device of (A) and (B).

42 (A) to FIG. 42 (C) are FIGS.
It is the schematic which shows an example of the screen displayed on the display part of the display device of (B).

FIG. 43A is a flowchart showing an operation procedure performed by the operation system of the display device in FIGS. 33A and 33B. FIG. 47B is a flowchart illustrating step 131 of the flowchart in FIG. 43A in further detail. FIG. 47C is a flowchart illustrating step 134 of the flowchart in FIG. 43A in further detail.

FIG. 44 is a schematic view of a display screen showing an example of another embodiment of the display device according to the present invention.

FIG. 45 is a schematic explanatory view showing a higher-level menu group, a lower-level menu group, and a setting display screen displayed stepwise on the display unit according to the control system of the display device in FIG. 44.

FIGS. 46A and 46B are schematic diagrams showing an example of a screen displayed on the display unit of the display device in FIG.

FIGS. 47A and 47B are schematic diagrams showing an example of a screen displayed on the display unit of the display device of FIG.

FIGS. 48A to 48F are schematic diagrams showing an example of a screen displayed on the display unit of the display device of FIG.

FIGS. 49A to 49F are schematic diagrams showing an example of a screen displayed on the display unit of the display device in FIG. 44.

50 (A) to 50 (F) are schematic diagrams showing an example of a screen displayed on the display unit of the display device of FIG. 44.

FIGS. 51A to 51F are schematic diagrams showing an example of a screen displayed on the display unit of the display device of FIG. 44.

FIG. 52A is a schematic diagram of a display screen showing another example of the display device according to the present invention. FIGS. (B) and (C) are schematic diagrams showing an example of a screen displayed on the display unit of the display device in FIG. 52 (A).

FIGS. 53 (A) to (D) are schematic diagrams showing an example of a screen displayed on the display unit of the display device in FIG. 52 (A).

FIGS. 54A to 54D are schematic diagrams illustrating an example of a screen displayed on the display unit of the display device in FIG. 52A.

FIGS. 55A to 55C are schematic diagrams illustrating an example of a screen displayed on the display unit of the display device in FIG. 52A.

FIGS. 56A to 56C are schematic diagrams showing an example in which a portable information processing apparatus according to the present invention and a personal computer form a network and perform data synchronization.

FIG. 57 is a schematic diagram showing an example of a screen configuration of a calendar display in a conventional display device.

[Explanation of symbols]

 2 Mobile device 21 Clock section 22 Storage section 23 Display section 24 Operation section 25 Communication means 26 Audio output section 27 Audio input section

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Kenji Tanikawa 3-5-5 Yamato, Suwa-shi, Nagano Seiko Epson Corporation (72) Inventor Roy Nakashima 1030 Ellis Avenue San Jose Ca California United States 95125 F-term (reference) 5B019 HD09 HD13 HE18 KA04 5E501 AA04 AC12 BA05 CA04 CB07 DA15 EA11 FA04 FA14 FA22 FB04 FB25 FB28

Claims (18)

[Claims] A plurality of types of information having different attributes, a plurality of pieces of attribute information for identifying types of the plurality of types of information, a plurality of pieces of time information related to the plurality of types of information,
A plurality of types of icon information respectively corresponding to the plurality of pieces of attribute information, and time axis display data for displaying a time axis;
A storage unit in which at least the time axis and the icon information are displayed on a display screen; and a plurality of attributes corresponding to the plurality of types of information based on the attribute information. Selecting the icon information, based on the time information related to the plurality of types of information, displaying the selected icon information on the display screen so as to be arranged at corresponding times on the time axis, respectively. A display device, comprising: control means for controlling. 2. The display device according to claim 1, further comprising a clock unit for measuring a current time, wherein the control unit displays the current time on the time axis based on the current time measured by the clock unit. A display device for changing display of the icon information with respect to the display device. 3. The display device according to claim 1, wherein at least one of the plurality of pieces of time information includes transfer time information for transferring at least one of the plurality of types of information. 4. The display device according to claim 1, wherein the second storage unit has background display data for displaying a background of a time axis display area on the display screen, and the control unit stores the time information and the time information. A display device comprising: a background screen generating unit that combines the time axis on the background screen based on time axis display data and the background display data. 5. The display device according to claim 4, wherein the second storage unit has background screen coloring data for coloring and displaying a background screen for displaying a background of the time axis display area as a background. Based on the current time information and the background screen coloring data,
A display device, wherein a background color of each of the divided display areas on the display screen is controlled to be colored and displayed in different colors. 6. The icon information according to claim 4, wherein the icon information has a predetermined time width along the time axis, and the second storage means stores the time width of the icon information on the time axis. It has time axis coloring data for coloring and displaying the corresponding time region, and the background screen generation unit corresponds to the time width of the display position of the icon information based on the time information and the time axis coloring data. A display device, wherein the time axis in a time domain is controlled so as to be colored. 7. The display device according to claim 4, further comprising: an operation unit for operating the icon information on the display screen, wherein the time axis display data is displayed in a first hierarchy divided and displayed in units of time. The first hierarchy display time axis data to be displayed, the second hierarchy display time axis data to display the second hierarchy divided and displayed on a daily basis, and the second hierarchy display time axis data divided and displayed on a weekly basis A third hierarchy display time axis data for displaying a third hierarchy, and a fourth hierarchy display time axis data for displaying a fourth hierarchy divided and displayed in units of months; Means for selectively selecting each of the first to fourth layers on the display screen based on information input by the operation means and the first to fourth layer display time axis data; Display device having a hierarchical control unit for controlling display on a display device . 8. The time axis according to claim 7, wherein the control means is configured to input information for enlarging or reducing a unit time interval in a direction along the time axis. A display device wherein display control is performed so that a unit time interval can be changed so as to be scaleable. 9. The size of the icon information according to claim 8, wherein the control means interlocks with the enlargement / reduction of the time axis based on an operation input of the operation means to which information is input by an operation input. A display device that controls display so as to be able to change the size of the image. 10. The control device according to claim 9, wherein the control means has an axis having a predetermined width in a direction intersecting with the time axis in conjunction with expansion and contraction of the time axis based on an operation input of the operation means. A display device, wherein display control is performed so as to enlarge or reduce a width. 11. The display device according to claim 4, wherein the control means controls the display of the icon information, which disappears from the display screen as time elapses, in a catch net area provided in the time axis display area. Characteristic display device. 12. The control unit according to claim 1, wherein the plurality of types of information include electronic mail information transmitted and received via a communication unit, and arrival time information on an arrival time of the electronic mail information. And displaying the icon information on the display screen in order of arrival based on the arrival time information. 13. The information processing apparatus according to claim 1, further comprising: an operation unit configured to operate the icon information on the display screen, wherein the plurality of types of information are input information input by operation, and the input information is input operation information. The input device includes: input time information; and the control unit displays the icon information on the display screen in the order of creation based on the input time information. 14. The input information according to claim 13, wherein the input information has designated time information in which a user designates a scheduled execution time of the input information, and the control means controls the icon information based on the designated time information. Display processing on the display screen in order of scheduled time. 15. A portable information processing device including the display device according to claim 1. Description: 16. The portable information processing device according to claim 15, further comprising: an arm mounting portion disposed on the display device and mounted on a user's arm. 17. An information recording medium for storing at least information for generating a display image, comprising: a plurality of pieces of attribute information for identifying a plurality of types of information; A plurality of pieces of time information, a plurality of types of icon information respectively corresponding to the plurality of pieces of attribute information, time axis display data for displaying a time axis, and attributes of the plurality of types of information based on the attribute information. Select the icon information respectively corresponding to the plurality of types of information, based on the time information related to the plurality of types of information, the display screen so that the selected icon information is arranged at the corresponding time on the time axis respectively An information recording medium, comprising: information for controlling the above display. 18. An electronic device comprising the information recording medium according to claim 17.