GB2385155A

GB2385155A - A method using iteretive categorisation cycles for integrated multi-device compound document structure, creation, representation, processing and interaction

Info

Publication number: GB2385155A
Application number: GB0113615A
Authority: GB
Inventors: Gordon Ross
Original assignee: Individual
Current assignee: Individual
Priority date: 2001-06-04
Filing date: 2001-06-04
Publication date: 2003-08-13
Anticipated expiration: 2021-06-04
Also published as: GB0113615D0; GB2385155B

Abstract

Computing intelligence is embedded in so many devices new requirements and opportunities emerge. To have more effective content delivery requires a method covering the whole information cycle, including delivery to diverse devices. This method of iterative categorisation cycles achieves this. The method creates information structures that can be navigated with multiple and consistent device interfaces for such navigation. This iterative approach opens up opportunities for managed information delivery. The method facilitates differential and co-ordinated information delivery to different physical devices according to display and other characteristics without document conversion or re-purposing. By creating structured document content differential content delivery is enabled via selection. Category structure facilitates information dissemination, as well as providing a framework for software development. Pervasive computing relates to a multitude of uncoordinated computing devices. Ubiquitous computing refers to a managed information cycle, across a multitude of categories and devices, with information co-ordinated for a user.

Description

A Method using Iterative Categorisation Cycles for Integrated Multi-Device Compound Document Structure, Creation, Representation, Processing and Interaction.

Scope of the Invention The present invention relates to methods and processes for creating, structuring and sharing via cycles of categorisation, information frameworks and interfaces across diverse computing and intelligent devices, the resulting interchanges made possible by such structuring and sharing between individuals, groups, documents and devices, the communications, community and commerce supported by such infrastructure, and the features, facilities, devices, and knowledge provided by the same including but not limited to hardware, software, communications and content.

Copyright Notice Portions of the disclosure of this patent document contain material that is subject to copyright. The copyright owner has no objection to the reproduction by anyone of the patent document or the patent disclosure as it appears in the Patent and Trademark office patent file or records but otherwise reserves all copyright rights whatsoever.

Introduction Description of document content within information technology has largely been restricted to two dimensions. This in part is a legacy of the limited and costly provision of computer processing when the desktop analogy was first devised.

Technological advances mean documents now have a variety of characteristics turning them into complex, compound documents that can be delivered to a variety of devices in a variety of ways. Computing and information processing paradigms need to evolve to reflect this.

With the explosion of electronic content and the improvements in the cost/performance ratio of computer chips, there are a variety of possible new forms of information representation. Classification and categorisation of information is more important and with shared categorisations two-way communication becomes possible.

Increasingly rich multimedia objects will facilitate communication. To support such compound documents new forms of document content structure are required, making explicit the links between the different media types relating to the same event. The novel method and device described here uses multi-dimensional classification, categorisation and communication to permit effective creation, distribution, receipt and communication about embedded information content without the need for document conversion. This ensures information can be communicated in a variety of formats, using the multi-dimensional structure, for delivery to different information

intensity channels. This makes possible the automatic re-purposing of information content for different information channels and information appliances by selection of appropriate content rather than by document conversion with its associated processing overhead. This retains the integrity of the original information that in this method can be accessed to any depth from any device, allowing for limitations of processing and display.

Background The printed word is largely a two-dimensional world, even with the introduction of hypertext linking. The physical world is three-dimensional, and the richness of the perceptual and cognitive experience is considerable. Graphics, pictures, video and audio streams add to the quality of human-computer-content interaction, but prior art models of human-computer-content interaction are restricted by adherence to an out of data two dimensional framework, implicitly or explicitly. The origins of the current desktop analogy which is so pervasive can be found in work at the Xerox PARC Research Centre, from the mid 1960's on. With their origins in patented photocopying techniques and technology, and with the limitations and costs of computer processing in that period, it is not surprising three-dimensional computer processing of images was hardly considered. Yet times move on and the abundance of computer processing power, and its relatively low cost, mean it is possible to consider alternative and more effective computing paradigms, and relate more closely to human cognitive and social abilities.

The Xerox model that evolved from intensive user observation and research was to mirror a professional workers desktop, with icons of documents laid on the desktop, and filing folders and drawers into which documents were placed when not in active use. This may seem trivial to today's computer user, but when systems capable of supporting the analogy first appeared at the beginning of the 1980's it was something of a revolution. Combined, as it was, with the appearance of 10 MB Ethernet networking and beside-the-desktop laser printers, the systems freed users wanting to produce documents from photo-typesetting with its associated costs, difficulties and delays.

The legacy of early inventions can have a profound and unrealised impact on subsequent developments. Even in today's modem computer interfaces we are still working largely with the document, file, filing folder and file drawer analogy. In the meantime with the explosion of the Internet and the World Wide Web we have a situation where many computer interfaces have moved to the hypertext model, with active links between pages and sites. To an extent there is a discontinuity between the models of computer storage and processing, and the models of human-computercontent interfaces. Such discontinuities are unlikely to last as they create the equivalent of a vacuum which newer solutions fill. The analogy of the flat document, seen through a window, filed in a flat file and then placed in a drawer needs to be updated, and the current method provides one way of achieving this.

The novel method and process described here addresses a core limitation of the early Xerox work, and all its subsequent evolutions and revisions. That limit is the restriction of the human-computer-content interface in general purpose end-user

computing to two dimensional objects, even those with hypertext links. Computer advances mean this artificial limitation can now be removed, and three dimensional, and more, interfaces can be considered and proposed.

Further this novel method and process uses iterative applications of basis components to create sophisticated structures for human-computer-content interactions. This goes beyond prior art to deliver more consistent, more integrated human-computer-content experiences, which exploit human perceptual, cognitive and social processes.

There have been many inventions that relate to multi-dimensional forms of computer representation, but these have tended to ignore human perceptual and cognitive elements, or have been restricted to hierarchical forms of information processing, or both. These limitations are overcome with this novel method and process.

For example Agrawal et al (1997 US Patent 5,647, 058) shows how multi-media records could be more effectively retrieved form a database by adding features to the index and then retrieving on the basis of a similarity index computed from those features. However there are potentially many different dimensions of similarity, and in the current novel method such similarity cues are the result of human social, cognitive, perceptual and electronic interaction, all of which were not addressed by Agrawal and his colleagues.

Methods and systems for electronic publishing have restricted themselves to the twodimensional nature of documents, for example, Time Base Pty (Patent WO 98/34179), where documents are decomposed into discrete elements, and version control is applied as elements change over time. Earlier elements co-exist with later elements so users can track changes. Again the human and cognitive processes of categorisation are absent. So although there is a proposal for intra-document tagging with SGML, HTML and XML tags, and inter-document tagging with Document Type Definitions (DTD) and Style Sheet Mechanisms (SSM), there is no process for the continual production of content streams delivered to shared cognitive and content categories.

The databases in the Time Base example and in many other novel approaches are hierarchical, and exclusive, so cannot deal with overlapping categories, and the focus is on post creation content analysis of documents, not on their pre-classification, categorisation and structuring. There is no relationship between document creation and the end-user activities associated subsequently with the document and these two phases share no common elements.

Likewise Carlino (1999 Patent GB 2 344 197) places the emphasis on post-document conversion to deliver content to different devices, but this means the integrity of the information is lost. Again our novel method and process goes further. By using an iterative method to structure content, categories and classes of information not only can that information be navigated, but also relying instead on content extraction eliminates the need for document conversion.

One of the largest limitations of prior art is it limits itself to strictly logical approaches to classification and display, and ignores the psychological requirements and opportunities. Logically the same element cannot be in more than one place at the same time, yet psychological it is possible for elements and categories to enjoy

multiple positions in multiple categories at one and the same time. Art, laughter and many other aspects of human behaviour exploit this capability of multiple categorisation, yet computing innovations largely ignore it because it is difficult to deal with in a totally automated manner. Instead this novel method ensures human cognitive and creative processes are involved in classification and categorisation.

So for example, Agrawal et al (1998 US Patent 5,799, 300) provide an efficient method for selecting and combining data elements within a data cube, but only where the same item cannot appear in multiple categories or positions in the data cube at the same time. Similarly Pooser and Pooser (1998 US Patent 5,812, 134) provide techniques for users to navigate hierarchical information spaces within databases.

This has the advantage of allowing the user to view the logical relationships between particular units and the overall structure, but is not able to deal with the psychological processes involved where the are multiple, non-exclusive, overlapping and simultaneous relationships between elements.

Similar limitations of a focus on exclusively logical relationships applies to Agrawal et al (1998 US Patent 5,832, 475) in their work on"Group-by"operations within data cubes. The same limitations apply to the work by Cline et al (1999 US Patent 5,900, 880) which explores how to create surfaces with visual perspectives from mathematical calculations of points within surfaces and cubes. In neither these nor other cases is there any process for the creation of psychological, not logical, entities with the creation of data tied to its presentation and navigation through the application of iterative base building blocks as there is in the current novel invention.

Where more attention is given to the human component in human-computer interaction, as in the invention of a navigation method in 3D computer-generated pictures by 3D image manipulation (Benayoun 2000, WO 00/42495), there is no differentiation of the content into psychological categories and classes and no link between the navigation device and the elements being navigated other than that both are in the same 3 dimensional space. Again a process tracking the whole information cycle, using the iterative application of components is absent.

With the developments and growth of the Web there are numerous inventions relating to the automated production of content for different audiences and devices. Almost exclusively the elements are treated as two dimensional flat structures, albeit with hypertext linking, and solutions focus inwards on computer processing, rather than on the psychological relationships between user, computer and content. Dimarco and Foster (1999 Patent WO 99/08205) address the opportunity for creating versions of multimedia documents for different audiences, with variations of both content and presentation through a process of adaptive generation from a"master"document.

In the Dimarco and Foster approach the master document contains information on the relevance of particular blocks and structures of text, and by combining this with a set of parameters generated for any particular audience a novel document can in theory be produced. Again there is a disregard for the psychological and social processes of sharing information structures. Nor is there any consideration of the process of generating streams of information for distribution to pre-classified structures. Instead the computer system is solely able to generate customised versions of documents from a totally closed system. This limitation is overcome in the novel method and process

described here. Further in the Dimarco and Foster method crucially there is no consideration and no scope for sending multiple versions of the same generic document to the same individual via discrete information channels, and co-ordinating the receipt of such to avoid unnecessary information duplication and redundancy whilst ensuring he recipient gets the information required in a timely manner. This neglect of the psychological processes in the end-to-end delivery cycle, with human input at both sender and receiver points, using an iterative structure for content structuring and navigation are limitations in the Dimarco and Foster model. In addition whilst the phase of authoring of documents is addressed, their subsequent processing, packaging, dispatch, receipt, navigation and storage are all neglected elements of the end-to-end cycle. These are all features of the current novel invention.

Finally the components in the Dimarco and Foster model are arranged in a hierarchy of predetermined relationships thereby excluding its relevance to the non-hierarchical categorisations described in the current method and process and structure.

It is clear that more attention is being paid to the customisation of web content for different devices, as two Patents Applications from IBM indicates (1999, GB 2 331 600 and 2000, GB 2 346 238) The former addresses the customisation of web pages based on requester type, to differentiate the capabilities of different display devices such as personal computers, Personal Digital Assistants, mobile phones and so on.

The second explores how XML tools can be applied to tailoring Web pages in other style formats such as SGML and HTML. In both instances only one part of a process cycle is addressed, divorced from the psychological processes of senders and receivers and so whilst relevant to the transformation of static Web pages they have limited relevance to the current novel invention which deals with all phases of the human-content-computer cycle.

With the multitude of different devices capable of being used by users, and with a multitude of possible information streams, the overall co-ordination of information becomes more complex. Ross (1996) showed how the information of an "information switch" into the processing and production of news agency information enabled the automated re-purposing of information for different information clients and information streams. The mirror image of such information switches are information "trackers"or"co-ordinators", and such devices of developments will be needed as the information infrastructure becomes more complex and diverse. Switches and trackers are logical components in our novel method, being part of the meta-framework applied to the content, categories and classes of information.

In addition Ross 1999a, b, c and d showed how information structures, computer processing, and human activity and navigation can all be performed within a coordinated framework defined by categorisation and organisation of the resulting categories. Here we go further with building structures for computing, content and navigation by applying the categorisation processes as a series. Such cyclical categorisation defines more differentiated and sophisticated structures for content, computing and human interaction.

Problem The number of different information delivery channels is increasing because of technological advances. It is no longer sufficient to have two-dimensional document representations within a multi-dimensional electronic space. Information delivery may be ubiquitous, but different information channels differ in the degree to which they can effectively support compound document architectures. To ensure information is delivered effectively to distinct channels requires a Meta Document Content Structure in addition to the inherent two-dimensional structure of any document. Such a Meta structure permits modification of the compound document architecture according to the information delivery channel, whilst retaining the inherent structure of the document. The Meta structure also makes it possible to carry additional information about a document and to link a document to other documents. It permits additional coding of events, with any particular event subsuming multiple documents with similar or different document architectures.

Key issues arise when the focus of attention, as here, is on a whole cycle of information, from creation through processing and transmission to receipt, navigation, action and storage. Methods and processes that attempt to deal with phases of the cycle have limitations when seen from the context of the end-to-end process. For example it is not just the creation and translation of documents according to predefined computer algorithms, it is also the tracking of the documents as they may go via a variety of devices with different characteristics to the end user. Further, unlike prior art approaches which restrict the method and approach to hierarchical nonoverlapping information schemas, it is considered vital that a method and process is able to deal with multiple simultaneous categorisations and classifications. This is what differentiates the current approach. In addition a method and process has to deal with the phases, and the interfaces between phases, for example category and content creation, category and content sharing, and population of categories by sources and streams of content, and the timely decay of said to avoid information overload. This current method and process does.

Essential Features Three dimension forms of representation have been proven useful in domains such as social group interactions (Ross 1979) and they apply equally well to computer generated content. The method or meta-framework described below means the same document content can be automatically delivered to different information channels with greater or less degrees of content elaboration according to the capability of any particular channel. Where this Meta-framework is used to code documents at source information streams can be re-purposed in an automatic fashion for delivery to different information intensity channels, whilst retaining the overall integrity of the information.

Where documents are coded, either at origination or subsequently, to a particular event or category then groups of documents can be interrelated which improves speed of retrieval and improves depth of user understanding of an event or events.

This method makes use of a Visual Language Interface (VLI) for describing content organisation, computer processing and human activities including navigation. In addition there is a Standardised User Interface (SUI) bringing consistency to users using different information appliance devices. The Visual Language Interfaces uses a multi-dimensional representation for human-computer-content interaction whilst the Standard User Interface uses information categorisation and structures to differentiate classes of content and events.

The Meta-structure makes it possible to gather public or private comments and communications about the document content in an easy manner and to make these available to the document author (s).

The document Meta-structure and event links can be used in support of electronic commerce applications by taking users through structured sequences of changing information towards and beyond an electronic transaction.

This method enables the creation, display, communication and modification of simple or compound multimedia documents, using a multidimensional structure to store and code the information content and associated information and the interrelationships between the various elements of the information, to permit transmission of some or all of the content to the full range of information appliances and devices with different inherent receipt and display characteristics, The method preserves the underlying information integrity, and makes available the full information content to one or more appropriate devices and maintains a historic record to the transactions and information exchange, with such information available to be used or passed on to designated third parties for back-up, billing, and replication purposes, including the forward transmission to others using electronic mail and other forms of communication, such method comprising: The method addresses the origination of a document within a specified document content structure, or the translation of existing documents and media types into a compatible form of content structure, with none, some or all of the other multidimensional fields filled. Category tags linked to the document at the point or origin or subsequently permit document categorisation and classification tags to be used in automated or semi-automated forms of delivery and display and interaction This method of linking associated elements of different media types including text, graphics, data, audio video and other formats, to a document content structure permits suitably equipped receiving devices to play and display the elements, and where allowed, edit said documents or forward them to others This method allows interaction and editing within a compound document structure such that some or all of the media types, other than information which should not be altered, to be edited, amended and modified within the document without the need for additional third party software applications. This ensures easy and efficient handling of a document and the document contents, with the ability to forward said document to the originator and ! or others with the modifications, the author of such modifications to then be added to the document history as a contributor, whilst preserving the integrity of the original document.

The method enables the differential delivery of elements of the compound document, whilst preserving the whole, to allow for speedy delivery of some elements, ahead of other elements in a limited bandwidth environment. This can also speed user response times, with intense media applications capable of being loaded in background, or in anticipation of possible interaction, as well as in response to direct requests for an element or application.

The description of documents along dimensions relating to the document, its content structure and the delivery device characteristics open up new opportunities for information processing, retrieval and communication.

As will be appreciated by one skilled in the art, the present invention may be embodied as a method, process, structure, data processing system, computer program product, hardware embodiment or other article of manufacture. It can operate as a stand-alone product or as a component in a network of computers, switches, routers and other devices, and can be separate from or linked and associated with one or more databases of a variety of types, both hierarchical and non-hierarchical. Furthermore, the present invention and derivatives thereof may take the form of computer programme products on computer-usable storage medium having computer-usable program code and may be embodied in the medium with any suitable computer readable medium and networking and inter-networking device. Likewise any computer storage mechanisms, permanent and temporary can be utilised. A computer, personal digital assistant, screen, keyboard and other interactive devices, mobile or land phone, video conference system, television, consumer device, storage medium and mechanisms can be conceived to facilitate the practices of the method of the invention. It will be understood that such apparatus and articles of manufacture and hardware software and networks also fall within the spirit and scope of the invention.

A number of preferred embodiments of the present novel invention have been described in some detail herein and for those skilled in the art many modifications and variations will be apparent. It is my intent therefore to be limited only by the scope of the appended claims, and not by the specific details presented by way of example and illustration.

Introduction to Drawings The present invention will become more fully understood, and the foregoing and other features and advantages of any preferred embodiment will become more readily apparent by describing by way of example only and with reference to the following drawings and descriptions, which are not limitative of the present invention, by which :- Figure 1 shows an example of a document content structure with a variety of faces for different media types and their inter-relation Figure 2 shows an example of how a story layout with multi-media object types in the story, can be sent to other information appliances, able to read some or all of the elements of the story. This also provides for the possibility of communication between readers of a document and other readers or the author (s). Such structured and

managed two or more way communication is only possible with a degree of formal content and other structuring.

Figure 3 illustrates the document category structures, which is iteration above the document content level. Here groupings of documents populate a category. These population items can be sent with the information structure, or filled or populated with items from sources, streams, multi-casts or other distribution methods. Such items can supplement, complement or replace earlier items according to user and system preferences and settings.

Figure 4 gives example of different subdivisions within an overall structure. They show example structure tags attached to faces of a cube. Together the various faces define the content, category and coding structures to permit automatic delivery to different information channels from different information streams. By ensuring standardisation of the structures and methods different streams can be used to populate the same information spaces if so required by the user.. The expanded view of the Cube in the example is opened out is for "Information, Communication, Entertainment (ICE)"environment while a second Cube example differentiates Global, Local and Focal Events, Experiences and Activities. Cubes can be structured according to personal preferences if required.

Figure 5 provides a further expanded view example of a Cube differentiated according to different attitude, interests and beliefs. This illustrates the iterative nature of the method, with the same processing of categorisation and classification being used in different areas. The overall consistency of the method ensures consistency of subsequent navigation, access and interaction, despite differences in device types and characteristics.

Figure 6 shows the Iterative nature of the method and process and structure, with iterative application of the process moving the user between document content and different levels of document categories and classes.

Figure 7 shows a particular embodiment of the multidimensional Meta-structure, in this case a cube, although all other shapes are possible. The faces of the cube show illustrations of the meta-structure and process attached to different sides of the cube for information about both the structure and the content of a compound document. In this example any multi-media content would be represented as a Cube within a Cube. Figure 7 also provides an illustration of the navigation techniques within and across the faces of the structure in a consistent and straightforward manner.

Figure 8 provides an overview of the method and process for creating information structures, and then processing and packaging the information for distribution, integration, navigation, retrieval, storage and evolution. The one iterative method encompasses all these related activities in a framework that is straightforward to comprehend, and matches the multiple categorisation capability of individuals and groups. It indicates how origination and editing of different components can take place within the compound document structure without the need for third party software applications, making communication and modification of compound documents a straightforward matter. The steps of the method, or variations and modifications thereof to achieve the same or similar ends, include the following :-

1. Creation of the structures, classes and categories 2. Processing documents of single or multi-media content, with tags to single or multiple categories or classes 3. Packaging the information for dispatch over one or more methods of distribution 4. Sharing of the information structures with recipients of the information and populating from sources, streams or in other ways some of all of the elements of the information structure.

5. Linking and associating the different elements to existing or other information, for elaboration and explanation purposes 6. Navigating of the information structure using consistent methods across documents, categories and classes 7. Enabling information distillation (not decay) so that full information can be retrieved from local or remote storage across a variety of networks, ensuring the integrity of the information and the subsequent operations on such information. This has implications for example for copyright and royalty protection, ensuring authors and publishers'rights are protected. It also adds additional dimensions to considerations of security when combined with other factors such as persistent user identification and connection across diverse networks and operations.

8. Storage or the information 9. Evolution and modifications of the method and process to achieve similar ends, for example enabling the personalisation and tailoring of information streams, or the combination of different streams for the same or different categories according to personal preferences. For example some users may want multiple deliveries of essentially the same information for different perspectives or interpretations or elaboration or to ensure consistency. For example sports or news fans may want multiple sources delivering to the same categories and classes and likewise financial deals may want the security of multiple sources of financial information but delivered in consistent ways to a single information structure to facilitate comparisons.

Figure 9 shows some sample embodiments of the method and process in a variety of hardware and software devices and interfaces as examples. When applied this has the advantage of ensuring consistency of users across different devices, as well as economies of scale for component manufacturers.

Figure 10 provides a more detailed view of the type of telephone instrument possible when embodied with the method. Such a device would support a number of activities including content creation and navigation, web browsing and surfing, cube navigation as well as traditional landline and IP telephony.

Figure 11 illustrates the consistency of the interface that is possible when applied to devices other than telephones such as computers, flat screens and information kiosks.

Figure 12 differentiates the different views that are possible through the different faces of a structure including global local, focal and personal views amongst others.

Without differentiation the views could interfere with each other, limiting access and navigation. With the differentiation the method provides it is easy to see how information organisation is facilitated.

Figure 13 indicates the active relationship between a viewer and the view that is being viewed to highlight the importance of the relationship between view and viewer. Such relationships are an important feature of the method and process. Only a few visual cues are needed for quite strong cognitive and social processes to come into play. Human perceptual and cognitive processes can reconstitute views from even minimal cues, and such information reconstitution is a feature of the novel method and process, albeit using the capabilities of computers and computer groupings, individually and across networks Figure 14 indicates the multiplicity of perspectives relating to any event, activity or experience, and demonstrates the need for methods and processes to co-ordinate the different perspectives that are possible in most situations.

Figure 15 shows the method and process for creating common information structures, for populating those structures with structured content and for subsequent navigation and personalisation and evolution of the structures. This comprises the following steps :- I. Developing an iterative method and process for application to and within different components of an information cycle 2. Using said method and process for creating a structure for information categories and classes 3. Sharing said structure between senders, receivers and intermediaries of information 4. Creating content that is itself structured in terms of format, content and other characteristics, with the ability for any single items to have multiple representation and occupation within different classes and categories 5. Providing an information source, stream, or multicast or other delivery technique to populate devices and the structures and classes and categories with information, or to supplement or replace previously delivered information.

6. Using features of the method and process to navigate around the information structures 7. Personalising the structure according to further differentiated information needs 8. Evolving the structure and the information distribution streams to populate evolved structures Figure 16 provides examples where the base method and process can be applied to other areas, including

'Content and content sources, streams, and multicasts * A variety of device types and devices . Navigation within and across devices and content * Communications between individuals and groups and across networks

. Individual structures for organising information . Structures for organising group, organisation or enterprise information Figure 17 shows a matrix of single and multiple users and single and multiple devices and considers the interactions between the two. There are significant challenges as multiple users move towards accessing and interacting with information across multiple devices and the current method seeks to addresses some of the challenges.

Figure 18 indicates some of the process complexity of getting co-ordinated information to different devices, and indicates the need for both"switching agents" and"co-ordination agents".

Figure 19 illustrates how a multi-device environment is integrated with, and handled by, the basic novel method and process. This is an example of the receipt, display and co-ordination of multi-media material, and this method protects the delivery of a multi-dimensional multi-media document content and structure to facilitate multistream information delivery and receipt to different information intensity channels, and to support two-way information and transaction exchange.

Figure 20 provides an illustration of some of the dimensions of social groups, along each dimension of which there could be examples of single or multiple memberships, which may overlap.

Figure 21 illustrates how for each group there will be an associated list or database of members, and so for the space as a whole there will be multiple overlapping and intersecting non-hierarchical databases.

Figure 22 shows how the base method and process copes with multiple memberships.

Figure 23 illustrates the core iterative method that can be applied to different dimensions and domains. Each iteration takes the infrastructure to a higher level of complexity, yet the overall structure and simplicity is retained. Navigation is therefore consistent no matter how many levels are introduced.

Figure 24 shows how content is handled going from the structured document content of cube 1 documents, through categories and classes to locate any particular document within the overall structure, even if there are multiple instances of the same document in different categories and classes.

Figure 25 shows the iterative application to category structures, and the correlation between the structures and the interfaces and navigation Figure 26 shows the iterative application to computing devices and databases. Since events or items can be realised in any number of classes and categories this has implications for the database design, structure and processing.

Figure 27 illustrates how communications can exploit the same iterative structure locating people and groups into a variety of groups, classes and categories. Network

routing following such organised structures may be more direct and predictable than the random routings of the Internet. This would have important quality of service implications.

Figure 28 takes the same method and process to define more and less inclusive communities of people. As with items appearing in multiple categories so too can individuals and groups enjoy multiple memberships. Indeed it could be seen that the multitude of memberships defines the social identities of individuals and groups.

Figure 29 shows how commerce is possible within the same method process and structure, with goods and services provided locally or globally, or some combination of the two, depending on the requirements of providers and users.

Figure 30 indicates how with a correspondence between all these different dimensions, and with one common method and process and structure it is possible to conceive of a next generation web and internet, based on a degree of structure for the different human-computer-content interactions.

Examples A simple example of a document content structure is where a researcher publishes a document of research evidence, together with links to earlier related research papers, and gathers comments from readers of the paper when used in conjunction electronic communications facilities.

An example of the method and process in relation to content and community illustrates the principles in relation to more complex circumstances. A school or theatre or club may want to promote an event or activity. By liasing with domain owners it may be agreed to mail-shot everyone meeting certain criteria within one or more cube physical locations. In addition a wider communications can be targeted to those known to have a specific interest in the activity or event, so-called interest or focal groups. If tickets are booked over the same cube infrastructure then it provides an example of cube-related commerce. Finally a report of the event afterwards can provide content to those who have expressed an active interest in the event or activity.

Communications, community, commerce and content are intertwined in a series of activities that in the prior art would be much less focused, much less straightforward to support electronically, and more dependent on printed and published media.

Another example is an Information provider who sends the same core content, tailored to different channels, to a wireless channel, a newspaper information feed, and an interactive cable channel, with the information displayed at a depth appropriate to each of the channels. Using the current method such information packaging, distribution and tracking would be a relatively straightforward matter, and far more effective than using different groups of journalists for packaging information to different types of device.

In relation to the physical embodiment of the novel invention, a telephone handset operating in accordance with the method and process would become a multi-purpose device. To achieve this it requires a keyboard, either in the physical sense or as a

display on a touch sensitive screen. The correspondence between screen and keyboard, or indeed between two screens, one acting as a display the other as an input device, makes for easy interaction. Navigating the major faces of a multi-dimensional structure allows individuals to"home in"on a particular class of events, experiences and activities. This could be shopping, or entertainment, or hobbies, or communications as just some examples. Navigation within a face is straightforward. The same basic components can be used to generate e-mail or web browsing, as well as for telecommunications.

References Agrawal et al 1997 Method for high Dimensionality Indexing in a Multi-Media Database US Patent 5,647, 058 Agrawal et al 1998 Method and System for Performing Range-Sum Queries on a Data Cube US Patent 5,799, 300 Agrawal et al 1998 Database System and Method Employing Data Cube Operator for Group-By Operations US Patent 5,832, 475 Bayer R 1998 Database and Management Process for n-dimensional data structure DE 19635429A Benayoun 1999 Navigation Method in 3D Computer-Generated Pictures by Hyper 3D Navigator 3D Image Manipulation WO 00/42495 Carlino K 1999 Content Conversion of Electronic Documents Spyglass Inc.

Patent GB 2 344 197 Cline and Lorensen 1999 3D Surfaces generated from a List of Cubic Elements US Patent 5,900, 880 Earle 1995 Method and Apparatus for Storing and Retrieving Multi- Dimensional Data in Computer Memory US Patent 5,359, 724 Egger et al 1996 Method and Apparatus for Indexing, Searching and Displaying Data US Patent 5,832, 494 Hitachi 1997 Method for Table Graphic Display and Processing JP 09-081114A Liaw et al 1996 System and Method for Multi-Dimensional Information Processing US Patent 5,572, 644 Philips Electronics 1997 Spatial Browsing Approach to Multimedia Information Retrieval WO 98/53391

Pooser and Pooser 1996 User Interface Navigational System and Method for Interactive Representation of Information Contained within a Database US Patent 5,812, 134 Ross 1979 Multiple Group Membership, Social Mobility and Intergroup Relations. An Investigation of Group Boundaries and Boundary Crossings. Ph. D Thesis, University of Bristol, England.

Ross 1992"Information Technology-the Catalyst for Change" PA Consulting Group, Mercury Books, ISBN 1 85251 042 0 Ross 1996 Newsroom 2000-Keynote Address, IBM Technical Interchange, Paris Ross and Ioannou 1996-2 1"Century Content Engines- In"Digital Newsrooms of the Future"-Seybold Report on Publishing Systems Vol. 25 Number 18, ISSN: 0736-7260 June, 1996 Ross 1999a A Method for Multi-Dimensional Human Computer Processing, Interaction and Interfaces Using Information Categorisation and Visualisation. UK Patent Application GB 9915892.5 Ross 1999b A Method for Multi-Dimensional Information Representation Processing and Interaction Using Categorisation Structures and Processes UK Patent Application GB 9915893.3 Ross 1999c A Method for Integrated Multi-Media Compound Document Structure, Creation, Representation, Processing and Interaction UK Patent Application GB 9915894.1 Ross 1999d Multi-dimensional Computer Supported Communications Using Database Linking and a Visual Language Interface UK Patent Application GB 9915895.8 Wolf et all998 Method of Performing a Parallel Relational Database Query in a Multiprocessor Environment US Patent 5,765, 146

Claims

Claims Having thus described my invention, what I claim and desire to secure by patent is: I A method and process and structure for information, content, navigation, communications and social interaction where elements and their interrelations and the devices to which information is distributed are multiple, overlapping and intersecting with respect to the creation, processing, distribution, navigation, action and storage of data and information exchange and communications between individuals, groups, multiple groups, and multiple devices comprising the following :- 'Creation of a process for its iterative application to single or multiple points within an information cycle to produce consistent information structures, population of those structures and navigation of same across a variety of different devices with a harmonised and consistent human- computer-content interface 'mutual and shared systems of classification and categorisation between senders and recipients of information, grouping of categories within boundaries within and along dimensions of distinctive difference, z population of categories from streams of data and information elements that have been given one or more classifications within overall shared structures at source or before reception, distribution of the structured data, information, content and communications to a range and variety of different devices such as to maintain a family resemblance of interface, processing, navigation and action across said devices. navigation within and across devices using consistent techniques and methods * co-ordination of information, activities and transactions at sender, receiver and intermediary points to avoid duplication and enhance security the iterative application of the method to areas in addition to content, including but not limited to information categories and classes, communications and commerce within and between individuals and groups, communities of similar interest or interests, and communications and infrastructures and content distribution across such infrastructures 2 The method and process and structure of Claim I further comprising the step of using the shared process of classification and categorisation to structure and order content and streams of content such that items of data and information can be processed for single or multiple delivery from single or multiple <Desc/Clms Page number 17> sources in single or multiple categories to single or multiple devices successively or simultaneously so recipients of the information can select what they require from within an overall structure of categories and classes according to their needs, requirements and interests. 3 The method and process and structure of Claim 1 further comprising the step of being able to identify the overlaps and intersections of the different content social categorisations and different devices and further being able to deliver tailored content to the groups or devices so defined by the overlaps and intersections. 4 The method and process and structure of Claim 1 comprising the further step of being able to categorise at source in an automated fashion some or all of the streams of data and content according to distinctive characteristics of the source, location or other identifying features and deliver same to a variety of devices taking account of the information processing characteristics of the receiving devices. 5 The method and process and structure of Claim 1 further comprising the step of the automatic decay of information after selected time periods to different degrees and different devices such that the information categories and classes to not become overwhelmed with examples of the categorisation whilst permitting reconstitution of items from fragments of the remaining characteristics by interaction with local or remote storage devices. 6 The method and process and structure of Claim 1 further comprising the step of preserving and associating multiple classifications and links established at the time of creation of items relevant to multiple and intersecting classifications and multiple devices such that recipients of information can follow, use and exploit the linking and associated information if users should choose to do so. 7 The method and process and structure of Claim 1 further comprising the step of receiving, organising and retrieving simple or compound documents or other information into hierarchical or non-hierarchical databases with visual and other cues for the display on single or multiple devices of the information in multi-dimensional spaces according to pre-coded and self-coded differentiated categories that may be discrete or overlapping. 8 The method and process and structure of Claim 1 further comprising the step of online or wireless or some other form of receipt of information items or streams of information items that are classified at the point of origin or some intermediate point, or via context sensitive analysis at the point of receipt, to allow delivery within the multi-dimensional space according to single or multiple category classifications and/or codes, these being associated with faces and/or cells of the overall structure, and to maintain the family resemblance of delivery across a variety of devices with information going to same simultaneously or successively. <Desc/Clms Page number 18> 9 The method and process and structure of Claim 1 further comprising the step of information delivery taking place within major grouping of Categories known as Classes according to the classificatory schema and multi- dimensional space characteristics so that discrete classes of information can be displayed in a structured format depending on the nature of the information content and source, and delivered in an appropriate way to a multitude of devices. 10 The method and process and structure of Claim 1 further comprising the step of said information being delivered with global, or local or intermediate and/or other cues so information can be presented in structured methods according to content, time, geography, or some combination of these and other elements or components, with different elements and/or depth of information available if requested and ! or selected according to the information processing characteristics of any one of a multitude of receiving devices. 11 The method and process and structure of Claim 1 further comprising the step of organising and tracking information within the categories made available to the same individual at different times or in different formations or to one or more recipients via one or more devices according to structural or user-defined preference, and structured or ranked according to predefined or user defined methods, rankings and processes. 12 The method and process and structure of Claim 1 further comprising the step of information retaining cues relating to its origination, and intermediary processing, across a multitude of devices for security and so interaction and response can take place, for information elaboration and electronic transactions as well as for forms of billing, whatever the form of the billing algorithm, and for improved security of cross-network activity be these networks fixed or mobile or both. 13 The method and process and structure of Claim 1 further comprising the step of information agents from a variety of devices collecting and passing on data relating to interactions and transactions to designated third parties to allow for behaviour tracking, billing and security and integrity issues to be addressed, including off-site backup and replication of multidimensional information spaces and contents to allow for recovery after local failure and for remote access and interaction. 14 The method and process and structure of Claim 1 further comprising the step of the display of information categories within a multi-dimensional space presented in a standardised user interface across a multitude of devices as described by a common Visual Language Interfaces, this Visual Language Interfaces detailing both the structural and interactive features of the information, transaction and interaction environments. 15 The method and process and structure of Claim 1 further comprising the step of action on the information and transaction items across the different devices, with human or automated intervention for human or automated storage, linking and deletion of some or all of the elements of the individual or <Desc/Clms Page number 19> compound items, apart from elements needed for security and tracking and billing purposes. 16 A method and process and structure for multi-dimensional multi category, multi-device, multi group information and communication representation processes and interaction using shared categorisation structures and processes substantially as described herein with reference to Figures 1 - 30 of the accompanying drawing. <Desc/Clms Page number 20> Amendments to the claims have been filed as follows Claims. A number of preferred embodiments of the present novel invention have been described in some detail herein and for those skilled in the art many modifications and variations will be apparent. It is my intent therefore to be limited only by the scope of the appending claims, and not by the specific details presented by way of example and illustration. Having thus described my invention, what I claim and desire to secure by patent is:

1 A method and process for the classification and organisation of information into multidimensional information structures using hardware and software and human cognitive and perceptual processes with said structures appearing in all or in part as an interface on various devices, with content when formulated for transmission to the organised information structures having tags associated with the capabilities of receiving devices such that content can be presented within the device user interface in a manner appropriate to said device, unless a user selects to interact in a different manner so overall information structure and integrity is preserved across different channels and different devices.

2 The method and process of Claim I with the additional step of inserting a master multidimensional information space against which interactions and transactions of said space of discrete devices can be monitored and coordinated in one place, and used to maintain continuity with, and avoid duplication on, any other devices considered relevant by the user.

3 The method and process of Claim 1 with the additional step of transmitting information about the nature and extent of transactions within the multidimensional information space to other parties for the purposes of administration, security, billing and similar purposes.

4 The method and process of Claim 1 as applied to the creation of information structures applied also to the creation of multidimensional content to allow for differentiated delivery of content elements to different devices according to the requirements of the use and the capabilities of the device, individually and in interaction with each other.

5. The method and process of Claim 1 further comprising the step of using the shared process of classification and categorisation to structure and order content and streams of content such that items of data and information can be processed for single or multiple delivery from single or multiple sources in single or multiple categories to single or multiple devices successively or simultaneously so recipients of information can select what they require from within an overall structure of categories and classes according to their needs, requirements and interests.

6. The method and process of Claim 1 further comprising the step of being able to identify the overlaps and intersections of the different content social

categorisations and different devices and to be able to deliver tailored content to the groups or devices so defined by the overlaps and intersections.

7. The method and process of Claim 1 comprising the further step of being able to categorise at source in an automated fashion some or all of the streams of data and content according to distinctive characteristics of the source, location or other identifying features and deliver same to a variety of devices taking account of the information processing characteristics of the receiving devices.

8. The method and process of Claim 1 further comprising the step of the automatic decay of information after selected time periods to different degrees and different devices such that the information categories and classes to not become overwhelmed with examples of the categorisation whilst permitting reconstitution of items from fragments of the remaining characteristics by interaction with local or remote storage devices, across intervening networks.

9. The method and process of Claim 1 further comprising the step of preserving and associating multiple classifications and links established at the time of creation of items relevant to multiple and intersecting classifications and multiple devices such that recipients of information can follow, use and exploit the linking and associated information if users should choose to do so.

10. The method and process of Claim 1 further comprising the step of receiving, organising and retrieving simple or compound documents or other information into hierarchical or non-hierarchical multidimensional information structures with visual and other cues for the display on single or multiple devices of the information in multi-dimensional spaces according to pre-coded and self- coded differentiated categories that may be discrete or overlapping.

11. The method and process of Claim 1 further comprising the step of online or wireless or some other form of receipt of information items or streams of information items that are classified at the point of origin or some intermediate point, or via context sensitive analysis at any point during delivery, to allow population of categories within the multi-dimensional space according to single or multiple category classifications or codes, these being associated with faces or cells of the overall structure, and to maintain the family resemblance of delivery across a variety of devices with information going to same simultaneously or successively.

12. The method and process of Claim 1 further comprising the step of information delivery taking place within major grouping of Categories or Classes according to the classificatory schema and multi-dimensional space characteristics so discrete classes of information can be displayed in a structured format depending on the nature of the information content and source, and delivered in an appropriate way to a multitude of devices.

13. The method and process of Claim 1 further comprising the step of said information being delivered with global, or local or intermediate or other cues so information can be presented in structured methods according to content, time, geography, or some combination of these and other elements or

components, with different elements or depth of information available if requested or selected according to the information processing characteristics of any one of a multitude of receiving devices.

14. The method and process of Claim 1 further comprising the step of organising and tracking information within the categories made available to the same individual at different times or in different formations or to one or more recipients via one or more devices according to structural or user-defined preference, and structured or ranked according to redefined or user defined methods, rankings and processes.

15. The method and process of Claim 1 further comprising the step of information retaining cues relating to its origination, and intermediary processing, across a multitude of devices for security so interaction and response can take place, for information elaboration and electronic transactions as well as for forms of billing, whatever the form of the billing algorithm, and for security of cross- network activity be these networks fixed or mobile or both.

16. The method and process of Claim 1 further comprising the step of information agents from a variety of devices collecting and passing on data relating to interactions and transactions to designated third parties to allow for behaviour tracking, billing and security and integrity issues to be addressed, including off-site backup and replication of multidimensional information spaces and contents to allow for recovery after local failure and for remote access and interaction.

17. The method and process of Claim 1 further comprising the step of the display of information categories within a multi-dimensional space presented in a standardised user interface across a multitude of devices as described by a common Visual Language Interfaces, this Visual Language Interfaces detailing both the structural and interactive features of the information, transaction and interaction environments.

18. The method and process of Claim 1 further comprising the step of action on the information and transaction items across the different devices, with human or automated intervention for human or automated storage, linking and deletion of some or all of the elements of the individual or compound items, apart from elements needed for security and tracking and billing purposes.

19. A method and process for multi-dimensional multi category, multi-device, multi group information and communication representation processes and interaction using shared categorisation structures and processes substantially as described herein with reference to Figures 1-30 of the accompanying drawing.