WO2016069869A1 - Dynamically loading contextual ontologies for predictive typing - Google Patents
Dynamically loading contextual ontologies for predictive typing Download PDFInfo
- Publication number
- WO2016069869A1 WO2016069869A1 PCT/US2015/058001 US2015058001W WO2016069869A1 WO 2016069869 A1 WO2016069869 A1 WO 2016069869A1 US 2015058001 W US2015058001 W US 2015058001W WO 2016069869 A1 WO2016069869 A1 WO 2016069869A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- ontology
- user
- context data
- input
- ontologies
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/332—Query formulation
- G06F16/3322—Query formulation using system suggestions
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/36—Creation of semantic tools, e.g. ontology or thesauri
- G06F16/367—Ontology
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
- G06F3/0233—Character input methods
- G06F3/0237—Character input methods using prediction or retrieval techniques
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
- G06F3/04895—Guidance during keyboard input operation, e.g. prompting
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/274—Converting codes to words; Guess-ahead of partial word inputs
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0641—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping
- G06Q30/0643—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping graphically representing goods, e.g. 3D product representation
Definitions
- This application relates to data processing.
- example embodiments may relate to systems and methods for dynamically loading contextual ontologies for predictive touch screen typing.
- FIG. 1 is a network diagram depicting a network system having a client-server architecture configured for exchanging data over a network, according to an example embodiment.
- FIG. 2 is a block diagram illustrating an example embodiment of multiple modules forming a contextual ontology application, which is provided as part of the network system of FIG. 1.
- FIG. 3 is an interface diagram depicting an example communication session, consistent with some embodiments.
- FIG. 4 is an interface diagram depicting further exchanges of the example communication session, consistent with some embodiments.
- FIG. 5 is an interface diagram depicting further exchanges of the example communication session, consistent with some embodiments.
- FIG. 6 is a flowchart illustrating an example method for providing a context based predictive typing entry, consistent with some example
- FIG. 7 is a flowchart illustrating an example method of pre-caching an ontology and providing a context based predictive typing entry, consistent with some example embodiments.
- FIG. 8 is a flowchart illustrating an example method for updating an ontology based on user input and context data, consistent with some example embodiments.
- FIG. 9 is a diagrammatic representation of a machine in the example form of a computer system within which a set of instructions for causing the machine to perform any one or more of the methodologies discussed herein may be executed.
- aspects of the present disclosure describe systems and methods for dynamically loading contextual ontologies for predictive touch screen typing.
- the context may include information relating to the current or prior
- the context may also be highly granular—for example, when writing a listing for a car for sale, the contextual ontologies loaded for predictive typing may initially be specific to the category of cars, or even a particular type or model of car. If the user should then list a sofa for sale, a different contextual ontology may then be loaded.
- a "user” or an “entity” may be a person (e.g., a human), a business (e.g., a company), an organization, a group of people, a persona (e.g., a fictitious character), a bot, or any combination thereof.
- Context data representative of the context of the session may be automatically stored, consistent with some embodiments.
- the method may include receiving user input, and in response to the user input, gathering the context data corresponding to the particular communication session, retrieving a corresponding ontology, presenting a predictive typing entry to the user based on the context data and the corresponding ontology, and updating the corresponding ontology based on the context data associated with the session and the user input.
- the method may further include generating and causing the presentation of a text suggestion.
- a user may be able to type on a mobile device and receive text suggestions based on the entered text which may be relevant to the particular context of the communication session.
- FIG. 1 is a network diagram depicting a network system 100, according to one embodiment, having a client-server architecture configured for exchanging data over a network.
- the network system 100 may include a network-based content publisher 102 in communication with a client device 106 and a third party server 114.
- the network-based content publisher 102 may be a network-based marketplace.
- the network-based content publisher 102 may communicate and exchange data within the network system 100 that may pertain to various functions and aspects associated with the network system 100 and its users.
- the network-based content publisher 102 may provide server-side functionality, via a communication network 104 (e.g., the Internet), to one or more client devices (e.g., client device 106).
- client devices e.g., client device 106
- the one or more client devices may be operated by users that use the network system 100 to exchange data over the communication network 104. These transactions may include transmitting, receiving
- the data may include, but are not limited to:
- the data exchanged within the network system 100 may be dependent upon user-selected functions available through one or more client or user interfaces (UIs).
- the UIs may be associated with a client device, such as the client device 106 using a web client 108.
- the web client 108 may be in communication with the network-based content publisher 102 via a web server 118.
- the UIs may also be associated with one or more applications 110 executing on the client device 106, such as a client application designed for interacting with the network-based content publisher 102, applications or services hosted by the network-based content publisher 102, or the third party server 114 (e.g., one or more servers or client devices) hosting a third party application 116.
- the client device 106 may be any of a variety of types of devices.
- the client device 106 may be a mobile device such as an iPhone ® or other mobile device running the iOS ® operating system, the Android ® operating system, a BlackBerry ® operating system, the Microsoft ® Windows ® Phone operating system, Symbian ® OS, or webOS ® .
- the client device 106 may alternatively be a tablet computer, such as an iPad ® or other tablet computer running one of the aforementioned operating systems.
- the client device 106 may also be a personal digital assistant (PDA), a personal navigation device (PND), a handheld computer, a desktop computer, a laptop or netbook, a set-top box (STB) such as provided by cable or satellite content providers, a wearable computing device such as glasses or a wristwatch, a multimedia device embedded in an
- GPS Global Positioning System
- data enabled book reader or a video game system console
- video game system console such as the Nintendo Wii ®
- the client device 106 may interface via a connection 112 with the communication network 104 (e.g., the Internet or a wide area network (WAN)).
- the communication network 104 e.g., the Internet or a wide area network (WAN)
- the connection 112 may be a Code Division Multiple Access (CDMA) connection, a Global System for Mobile communications (GSM) connection, or another type of cellular connection.
- CDMA Code Division Multiple Access
- GSM Global System for Mobile communications
- connection 112 may implement any of a variety of types of data transfer technology, such as Single Carrier Radio Transmission Technology (lxRTT), Evolution-Data Optimized (EVDO) technology, General Packet Radio Service (GPRS) technology, Enhanced Data rates for GSM Evolution (EDGE) technology, or other data transfer technology (e.g., fourth generation wireless, 4G networks).
- the communication network 104 may include a cellular network that has a plurality of cell sites of overlapping geographic coverage, interconnected by cellular telephone exchanges. These cellular telephone exchanges may be coupled to a network backbone (e.g., the public switched telephone network (PSTN), a packet-switched data network, or other types of networks).
- PSTN public switched telephone network
- packet-switched data network or other types of networks.
- connection 112 may be a Wireless Fidelity (Wi-Fi, IEEE 802. l lx type) connection, a Worldwide Interoperability for Microwave Access (WiMAX) connection, or another type of wireless data connection.
- the communication network 104 may include one or more wireless access points coupled to a local area network (LAN), a WAN, the Internet, or another packet-switched data network.
- the connection 112 may be a wired connection, for example an Ethernet link, and the communication network 104 may be a LAN, a WAN, the Internet, or another packet-switched data network. Accordingly, a variety of different configurations are expressly contemplated.
- FIG. 1 also illustrates the third party application 1 16 executing on the third party server 114 that may offer one or more services to users of the client device 106.
- the third party application 116 may have programmatic access to the network-based content publisher 102 via the programmatic interface provided by an application program interface (API) server 120.
- API application program interface
- the third party application 116 may be associated with any organization that may conduct transactions with or provide services to the users of the client device 106.
- the API server 120 and the web server 118 are coupled to, and provide
- the application server 122 may further host a plurality of user accounts for users of the network-based content publisher 102, which may be stored in a database 130. As illustrated in FIG. 1, the application server 122 may also host a contextual ontology application 126, which may be configured to provide a predictive typing entry from a corresponding ontology for predictive text, based on the session context. Such predictive text may, for example, be presented on the client device 106.
- the application server 122 may be coupled via the API server 120 and the web server 118 to the communication network
- the application server 122 is, in turn, shown to be coupled to a database server 128 that facilitates access to the database 130.
- the application server 122 can access the database 130 directly without the need for the database server 128.
- the database 130 may include multiple databases that may be internal or external to the network-based content publisher 102.
- the database 130 may store data pertaining to various functions and aspects associated with the network system 100 and its users.
- user accounts for users of the network-based content publisher 102 may be stored and maintained in the database 130.
- Each user account may comprise user data that describes aspects of a particular user.
- the user data may include demographic data, user preferences, and financial information.
- the demographic data may, for example, include information describing one or more characteristics of a user.
- Demographic data may, for example, include gender, age, location information, employment history, education history, contact information, familial relations, or user interests.
- the financial information may, for example, include private financial information of the user such as account number, credential, password, device identifier, user name, phone number, credit card information, bank information, transaction history or other financial information which may be used to facilitate online transactions by the user.
- the transaction history may include information related to transactions for items or services (collectively referred to as "products") that may be offered for sale by merchants using marketplace services provided by the network-based content publisher 102.
- products may, for example, include a description of a product purchased by the user, an identifier of the product, a category to which the product belongs, a purchase price, a quantity, or a number of bids.
- the user data may also include a record of user activity, consistent with some embodiments.
- Each user session may be stored in the database 130 as session data, and such session data may be maintained as part of the user data about each user.
- the user data may include past keyword searches that users have performed, web pages viewed by each user, products added to a user wish list or watch list, products added to an electronic shopping cart, and products that the users own. User preferences may be inferred from the user activity.
- the marketplace application 124 and the contextual ontology application 126 are shown in FIG. 1 to both form part of the network-based content publisher 102, it will be appreciated that, in alternative embodiments, the contextual ontology application 126 may form part of a service that is separate and distinct from the network-based content publisher 102.
- the network system 100 shown in FIG. 1 employs a client-server architecture, the present inventive subject matter is, of course, not limited to such an architecture, and could equally well find application in an event-driven, distributed, or peer- to-peer architecture system, for example.
- application server 122 may also be implemented as standalone systems or software programs, which do not necessarily have networking capabilities. It shall be appreciated that although the various functional components of the network system 100 are discussed in the singular sense, multiple instances of one or more of the various functional components may be employed.
- FIG. 2 is a block diagram illustrating an example embodiment of multiple modules forming the contextual ontology application 126, which is provided as part of the network-based content publisher 102.
- the contextual ontology application 126 is shown as including a communication module 200, a context data module 204, an ontology retrieval module 206, a predictive typing entry module 208, a presentation module 210, and an ontology database 202, all configured to communicate with each other (e.g., via a bus, shared memory, a switch, or application programming interfaces (APIs)).
- APIs application programming interfaces
- the various modules of the contextual ontology application 126 may access the databases 130 via the database server 128, and each of the various modules of the contextual ontology application 126 may be in communication with one or more of the third party applications 116. Further, the various modules of the contextual ontology application 126 may access a machine-readable memory of the client device 106.
- the communication module 200 may be configured to receive user input generated by one or more input/output (I/O) devices that may be included with or communicatively coupled to the client device 106.
- I/O devices may, for example, be a mouse, a track pad, a keypad, a keyboard, a multi-touch sensing surface (e.g., a touchscreen or trackpad), a microphone, a speaker, a camera, and the like.
- the user input may be received by one of the aforementioned I/O devices and, in some embodiments, transmitted to the application server 122 for receipt by the communication module 200.
- the ontology database 202 may be configured to store one or more contextual ontologies which may be accessed by the ontology retrieval module 206.
- ontologies in the ontology database may be defined as compositions of two or more increasingly specific ontology components.
- an ontology related to "Cars” may be composed of multiple increasingly narrow ontology components, such as an ontology representing "American Cars," an ontology representing "American Cars made by
- the context data module 204 may be configured to capture and store context data that is representative of a communication session and may be used to recall the content of the communication session at a later time.
- Context data refers to the content of a particular web site or application environment accessed by one or more applications 110 executing on a client device (e.g., client device 106).
- Example context data includes elements that describe the content and subject of a particular communication session, a user transaction history, a user query history, or actions performed by a user when conducting an online transaction, completing an online form, taking an online survey, writing an email, and creating a listing.
- the context data may include interactions of the client device 106 with the application server 122, such as information provided by a user, buttons (or other visual indicators) activated by the user, an identification of steps completed by the user, keystrokes, cursor and pointer movements, actions canceled by the user, and other types of clickstream data.
- the context data module 204 may be configured to monitor, track, and record the activities and interactions of a user, using one or more devices (e.g., client device 106), with the various modules of the network system 100.
- the ontology retrieval module 206 may be configured to retrieve a corresponding ontology from the ontology database 202, based on the context of a communication session.
- the user may manually specify a particular ontology to use through a user interface.
- the corresponding ontology provided to the user will then allow the predictive typing entry module 208 to generate more relevant and accurate predictive typing entries, based on the corresponding context data.
- the ontology retrieval module 206 may also be configured to regularly create ontologies to populate the ontology database 202.
- the ontology retrieval module 206 may regularly receive context data from a website or online marketplace. The ontology retrieval module may then use the gathered context data to create up to date and relevant ontology which may then be delivered to the predictive typing entry module 208 in order to create a predictive typing entry for the user.
- the ontology retrieval module 206 may be further configured to pre- cache a corresponding ontology based on a user history as well as the context data.
- the user history may include information related to previous listings created by the user, such as item attributes, location attributes, and pricing information.
- the ontology retrieval module 206 may also assign a rank to the corresponding ontology, and then select the corresponding ontology based on the relative rank with a particular user.
- the assigned rank may be based on relevance to a particular context, total usage by a particular user, or frequency of use overall, or usage behavior.
- the assigned rank may be based on a conversion rate, or return on investment associated with a particular ontology, wherein a higher conversion rate or return on investment corresponds with a higher ranking among the other ontology within the ontology database 202.
- a conversion rate is defined as the percentage of visitors to a particular website who complete a goal, as set by the site owner.
- the ontology retrieval module 206 may be further configured to create a new ontology based upon user input and user behavior. For example, a user may regularly use a particular word or phrase in conjunction with a particular context. The ontology retrieval module 206 may therefore assemble a corresponding ontology for the unique context, and store the ontology in the ontology database 202. In further embodiments, the ontology retrieval module 206 may also update the new ontology based on the real-time user inputs. In further embodiments. The ontology retrieval module 206 may further be configured to update the corresponding ontology based on the user inputs and context data. In doing so, the ontology may accurately correspond to a particular user's needs.
- the ontology retrieval module 206 may be configured to dynamically retrieve an ontology as the context data module 204 collects corresponding context data. In other embodiments, the ontology retrieval module 206 may be further configured to retrieve increasingly narrow ontologies from the ontology database 202. In even further embodiments, the ontology retrieval module 204 may be configured to retrieve two or more corresponding ontology, including a baseline ontology and a category specific ontology, so that the keywords, text predictions, and sequences that are generic don't have to be loaded again.
- the ontology retrieval module 206 may be configured to retrieve and stream an ontology to the user, starting with the most frequently used keywords within the corresponding ontology. For example, upon selecting an ontology for use based on the context data, the ontology retrieval module 206 may stream the most frequently used keywords by the user from with that corresponding ontology, ensuring that predictive typing entry module 208 can begin generating predictive typing suggestions immediately.
- the predictive typing entry module 208 may be configured to provide a predictive typing entry based on one or more parameters in conjunction with the corresponding ontology retrieved by the ontology retrieval module 206.
- the parameters may include the received user input, a user history, and context data surrounding the particular communication session.
- the predicted text may be in the form of words or phrases, or in further embodiments be a predicted price range, location prediction, or time frame, based on the context data.
- the predictive typing entry module 208 may provide the user with text suggestions which may not otherwise be suggested outside of that particular context, such as for words and phrases which are most commonly used in conjunction with sunglasses, or even more specifically, Ray-Ban sunglasses. In further embodiments, the predictive typing entry module 208 may also suggest a price range or time limit for the listing based on other similar listings for similar sunglasses.
- the presentation module 210 may be configured to present the text suggestion from the predictive typing entry module 208 to the user.
- the text suggestion may be provided to the user as a user selectable option, which the user can choose to accept or deny.
- the presentation module 210 may present two or more predictive typing entries to the user, from which the user may select.
- the presentation module 210 may respond by communicating the response to the predictive typing entry module 208.
- the predictive typing entry module 208 may then determine whether the particular ontology selected by the ontology retrieval module 206 is accurate for the particular context. In some embodiments, the predictive typing entry module 208 may then query the ontology retrieval module 206 for a different ontology, or may update the ontology with information from the particular context in order to create more accurate ontologies for future use.
- FIG. 3 is an interface diagram depicting an example communication session, consistent with some embodiments.
- the first client device illustrated in FIG. 3 is an interface diagram depicting an example communication session, consistent with some embodiments.
- the first client device illustrated in FIG. 3 is an interface diagram depicting an example communication session, consistent with some embodiments.
- the first client device illustrated in FIG. 3 is an interface diagram depicting an example communication session, consistent with some embodiments.
- the first client device illustrated in FIG. 3 is an interface diagram depicting an example communication session, consistent with some embodiments.
- FIG. 3 may correspond to the client device 106 of FIG. 1. As illustrated in FIG. 3
- the example communication session may include a user input 302, input by a user on an interface displayed on the client device 106 through a keyboard 308, which may be transmitted as a request to the application server 122.
- the user input 302 may be a search request in an online marketplace application, which may generate search results 306.
- a user typing the user input 302 may be provided with a contextual text suggestion 304 based on a corresponding ontology, the user input
- the context data may include information specific to a particular category, item type, or web site content, as well as the subject matter of the user input 302 itself.
- the user history may include information corresponding to a particular user, such as user profile information, previous search requests, a transaction history, and user selected preferences. For example, consistent with some example embodiments, the user may begin typing a search query using the communication module 200.
- the context data module 204 may gather corresponding context information, as well as information associated with the user history and the user input, which it may then provide to the ontology retrieval module 206.
- corresponding ontology may be provided to the predictive typing entry module
- the ontology retrieval module 206 may store and retrieve ontologies in the ontology database 202. Once a corresponding ontology has been selected by the ontology retrieval module 206, the predictive typing entry module 208 may use the corresponding ontology to generate the contextual text suggestions 304. The contextual text suggestions 304 may then be provided to the presentation module 210, which presents the contextual text suggestions 304 to the user.
- the presentation module 210 may provide the user with a single contextual text suggestion 304; however, in other embodiments the presentation module 210 may present two or more contextual text suggestions 304, from which a user may select. Upon the user selecting a suggestion, the presentation module may respond by providing the selection to the context data module 204, in order to refine the ontology to better fit the specific context.
- FIG. 4 an interface diagram depicting a user entering details for a listing in an online marketplace, consistent with some embodiments, is illustrated. As shown, the user may wish to fill in relevant details related to the posting in a detail field 406. In some example
- the contextual ontology application 126 may be configured to provide a user with a text suggestion 408.
- the text suggestion 408 may be based upon the context and parameters of a listing 402, such as an image 404 which represents the item, as well as a listing title 410.
- the context data module 204 may be configured to recognize context data from a corresponding image. For example, a user may upload or otherwise provide an image 404 which may identify a particular item to be used in a listing. The context data module 204 may then identify the image and deliver the associated data to the ontology retrieval module 206, which may then retrieve a corresponding ontology based on the image 404.
- the contextual ontology application 126 may then provide the user with the text suggestion 408, which the user may then decide whether or not to use through selection.
- the contextual ontology application 126 may be configured to dynamically provide a user with increasingly specific ontologies as more context data is gathered by the context data module 204. For example, once the context data module 204 identifies that the image 404 represents a pair of sunglasses, a corresponding ontology for sunglasses may be provided to the user to generate relevant text suggestions. As the user types and adds detail to the listing, for example by adding a listing title 410 which specifies a brand or type of sunglasses, the context data module 204 may dynamically identify these relevant attributes, and provide the user with a narrower ontology, for example an ontology corresponding to Ray-Ban sunglasses specifically. As the user continues to add details to the context of the listing, the context data module 204 will continue to dynamically identify and provide the data to the ontology retrieval module 206, in order to provide the user with the most relevant ontology or ontologies possible.
- FIG. 5 illustrates an interface diagram of an example scenario in which a user wishes to add price information 502 to a listing in an online marketplace.
- the contextual ontology application 126 may also be configured to provide a user with a price suggestion 504.
- the context data module 204 may recognize that a user is creating a listing in an online marketplace, based on relevant context data. The context data module 204 may then collect pricing information relevant to the current listing by retrieving pricing information for other similar listings, or from the user's prior transaction history. The presentation module 210 may then present the price suggestions 504 to the user, for user selection.
- FIG. 6 is a flowchart illustrating an example method 600 for providing a predictive typing entry to a user based on the context data, the received input, and the corresponding ontology.
- the method 600 may be embodied in computer-readable instructions for execution by one or more processors such that the steps of the method 600 may be performed in part or in whole by the application server 122 or the client device 106, and in particular the modules 200-210 comprising the contextual ontology application 126.
- the communication module 200 may receive a user input.
- the context data module 204 may gather context data corresponding to the input at operation 610.
- the context data module 204 may then deliver the context data to the ontology retrieval module 206.
- the ontology retrieval module 206 may select a corresponding ontology stored in the ontology database 202.
- the ontology retrieval module 206 may then provide the corresponding ontology to the predictive typing entry module 208.
- the ontology retrieval module 206 may stream the corresponding ontology to the user.
- the ontology retrieval module 206 may stream two or more corresponding ontology to the user, such that the ontology may be combined to form a larger more comprehensive ontology.
- the predictive typing entry module 208 may use the corresponding ontology and the context data to provide the user with a text suggestion through the presentation module 210. Upon receiving the text suggestion from the presentation module 210, the user may choose to select the suggestion, or ignore it. In some embodiments, the predictive typing entry module 208 may begin generating predictive typing entry while the
- FIG. 7 is a flowchart illustrating a method 700 by which the contextual ontology application 126 may pre-cache a corresponding ontology before receiving a user input.
- the contextual ontology application 126 may pre-cache an ontology based on a user history.
- the user history may include a user's transaction history, previous listings a user has viewed or created, a user's search query history, and the ontology most often used by a user.
- the communication module 200 may then receive an input from a user at operation 710.
- the predictive typing entry module 208 may immediately provide the user with text suggestions based on the received input and the pre-cached ontology, which the user may choose to accept or reject.
- the context data module 204 may gather context data corresponding to the user input. The context data module 204 may then provide the context data to the ontology retrieval module 206. At operation 725, the ontology retrieval module 206 may then provide a narrower and more specific ontology to the predictive typing entry module 208, based on the user input, the pre-cached ontology, and the context data gathered by the context data module 204. At operation 730, a predictive typing entry may be provided by the predictive typing entry module 208 and the presentation module 210.
- FIG. 8 illustrates a method 800 for updating an ontology within the ontology database 202 with user input data.
- the user input data can include information associated with the text inputs and accepted or rejected predictive typing entry suggestions. For example, a user may reject a particular text suggestion provided by the predictive typing entry module 208.
- the contextual ontology application 126 may update the corresponding ontology to eliminate a particular text suggestion in the given context.
- the contextual ontology application 126 may update the corresponding ontology to include the text input which the user provides in the place of the suggestion. In this way, the ontology may be regularly updated with relevant information corresponding to a particular context.
- the communication module 200 may receive a user input.
- the context data module 204 may gather context data corresponding to the input.
- the context data module 204 may then deliver the context data to the ontology retrieval module 206.
- the ontology retrieval module 206 may select a corresponding ontology stored in the ontology database 202.
- the ontology retrieval module 206 may then provide the corresponding ontology to the predictive typing entry module 208.
- the predictive typing entry module 208 may then generate a text suggestion and deliver the suggestion to the presentation module 210, which may then provide the suggestion to the user.
- the ontology retrieval module 206 may update the corresponding ontology based on the user's response to the suggestion. For example, should the user accept the suggestion, the ontology retrieval module 206 may update the corresponding ontology by increasing its rank in relation to other ontologies. However, should the user reject the suggestion and provide input text, the ontology retrieval module 126 may demote the rank of the corresponding ontology, and may also add the provided input text from the user to the ontology for future use.
- the ontology retrieval module 206 may also create new ontology, based on the typed inputs of the user.
- the ontology retrieval module 206 may create a new ontology based on the typed input, and update the new ontology with suggested keywords provided to the user realtime.
- Modules may constitute either software modules (e.g., code embodied on a machine-readable medium or in a transmission signal) or hardware modules.
- a hardware module is a tangible unit capable of performing certain operations and may be configured or arranged in a certain manner.
- one or more computer systems e.g., a standalone, client, or server computer system
- one or more hardware modules of a computer system e.g., a processor or a group of processors
- software e.g., an application or application portion
- a hardware module may be implemented mechanically or electronically.
- a hardware module may comprise dedicated circuitry or logic that is permanently configured (e.g., as a special- purpose processor, such as a field-programmabe gate array (FPGA) or an application-specific integrated circuit (ASIC)) to perform certain operations.
- a hardware module may also comprise programmable logic or circuitry (e.g., as encompassed within a general-purpose processor or other programmable processor) that is temporarily configured by software to perform certain operations. It will be appreciated that the decision to implement a hardware module mechanically, in dedicated and permanently configured circuitry, or in temporarily configured circuitry (e.g., configured by software) may be driven by cost and time considerations.
- the term "hardware module” should be understood to encompass a tangible entity, be that an entity that is physically constructed, permanently configured (e.g., hardwired) or temporarily configured (e.g., programmed) to operate in a certain manner and/or to perform certain operations described herein.
- hardware modules are temporarily configured (e.g., programmed)
- each of the hardware modules need not be configured or instantiated at any one instance in time.
- the hardware modules comprise a general-purpose processor configured using software
- the general-purpose processor may be configured as respective different hardware modules at different times.
- Software may accordingly configure a processor, for example, to constitute a particular hardware module at one instance of time and to constitute a different hardware module at a different instance of time.
- Hardware modules can provide information to, and receive information from, other hardware modules. Accordingly, the described hardware modules may be regarded as being communicatively coupled. Where multiple of such hardware modules exist contemporaneously, communications may be achieved through signal transmission (e.g., over appropriate circuits and buses that connect the hardware modules). In embodiments in which multiple hardware modules are configured or instantiated at different times,
- communications between such hardware modules may be achieved, for example, through the storage and retrieval of information in memory structures to which the multiple hardware modules have access.
- one hardware module may perform an operation and store the output of that operation in a memory device to which it is communicatively coupled.
- a further hardware module may then, at a later time, access the memory device to retrieve and process the stored output.
- Hardware modules may also initiate communications with input or output devices, and can operate on a resource (e.g., a collection of information).
- processors may be temporarily configured (e.g., by software) or permanently configured to perform the relevant operations. Whether temporarily or permanently configured, such processors may constitute processor-implemented modules that operate to perform one or more operations or functions.
- the modules referred to herein may, in some example embodiments, comprise processor-implemented modules.
- the methods described herein may be at least partially processor-implemented. For example, at least some of the operations of a method may be performed by one or more processors or processor-implemented modules. The performance of certain of the operations may be distributed among the one or more processors, not only residing within a single machine, but deployed across a number of machines. In some example embodiments, the processor or processors may be located in a single location (e.g., within a home environment, an office environment, or a server farm), while in other
- processors may be distributed across a number of locations.
- the one or more processors may also operate to support performance of the relevant operations in a "cloud computing" environment or as a “software as a service” (SaaS). For example, at least some of the operations may be performed by a group of computers (as examples of machines including processors), with these operations being accessible via a network (e.g., the Internet) and via one or more appropriate interfaces (e.g., APIs).
- SaaS software as a service
- Example embodiments may be implemented in digital electronic circuitry, or in computer hardware, firmware, or software, or in combinations of them.
- Example embodiments may be implemented using a computer program product, for example, a computer program tangibly embodied in an information carrier, for example, in a machine-readable medium for execution by, or to control the operation of, data processing apparatus, for example, a
- programmable processor a computer, or multiple computers.
- a computer program can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a standalone program or as a module, subroutine, or other unit suitable for use in a computing environment.
- a computer program can be deployed to be executed on one computer or on multiple computers at one site, or distributed across multiple sites and interconnected by a communication network.
- operations may be performed by one or more programmable processors executing a computer program to perform functions by operating on input data and generating output.
- Method operations can also be performed by, and apparatus of example embodiments may be implemented as, special purpose logic circuitry (e.g., an FPGA or an ASIC).
- the computing system can include clients and servers.
- a client and server are generally remote from each other and typically interact through a communication network.
- the relationship of client and server arises by virtue of computer programs running on the respective computers and having a client- server relationship to each other.
- both hardware and software architectures merit consideration.
- the choice of whether to implement certain functionality in permanently configured hardware e.g., an ASIC
- temporarily configured hardware e.g., a combination of software and a programmable processor
- a combination of permanently and temporarily configured hardware may be a design choice.
- hardware e.g., machine
- software architectures that may be deployed, in various example embodiments.
- FIG. 9 is a diagrammatic representation of a machine in the example form of a computer system 900 within which a set of instructions 924 for causing the machine to perform any one or more of the methodologies discussed herein may be executed.
- the computer system 900 may correspond to the client device 106, the third party server 114, or the application server 122, consistent with some embodiments.
- the machine operates as a standalone device or may be connected (e.g., networked) to other machines. In a networked deployment, the machine may operate in the capacity of a server or a client machine in a server-client network environment, or as a peer machine in a peer-to-peer (or distributed) network environment.
- the machine may be a personal computer (PC), a tablet PC, a set-top box (STB), a PDA, a cellular telephone, a smart phone (e.g., iPhone® ), a tablet computer, a web appliance, a network router, switch, or bridge, or any machine capable of executing instructions (sequential or otherwise) that specify actions to be taken by that machine.
- PC personal computer
- PDA personal area network
- smart phone e.g., iPhone®
- tablet computer e.g., a web appliance
- network router, switch, or bridge e.g., a network router, switch, or bridge, or any machine capable of executing instructions (sequential or otherwise) that specify actions to be taken by that machine.
- machine shall also be taken to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.
- the example computer system 900 includes a processor 902 (e.g., a central processing unit (CPU), a graphics processing unit (GPU), or both), a main memory 904, and a static memory 906, which communicate with each other via a bus 908.
- the computer system 900 may further include a video display unit 910 (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)).
- the computer system 900 also includes one or more input/output (I/O) devices 912, a location component 914, a disk drive unit 916, a signal generation device 918 (e.g., a speaker), and a network interface device 920.
- the I/O devices 912 may, for example, include a keyboard, a mouse, a keypad, a multi- touch surface (e.g., a touchscreen or track pad), a microphone, a camera, and the like.
- the location component 914 may be used for determining a location of the computer system 900.
- the location component 914 may correspond to a GPS transceiver that may make use of the network interface device 920 to communicate GPS signals with a GPS satellite.
- the location component 914 may also be configured to determine a location of the computer system 900 by using an internet protocol (IP) address lookup or by triangulating a position based on nearby mobile communications towers.
- IP internet protocol
- the location component 914 may be further configured to store a user-defined location in the main memory 904 or the static memory 906.
- a mobile location enabled application may work in conjunction with the location component 914 and the network interface device 920 to transmit the location of the computer system 900 to an application server or third party server for the purpose of identifying the location of a user operating the computer system 900.
- the network interface device 920 may correspond to a transceiver and antenna.
- the transceiver may be configured to both transmit and receive cellular network signals, wireless data signals, or other types of signals via the antenna, depending on the nature of the computer system 900.
- the disk drive unit 916 includes a machine-readable medium 922 on which is stored one or more sets of data structures and instructions 924 (e.g., software) embodying or used by any one or more of the methodologies or functions described herein.
- the instructions 924 may also reside, completely or at least partially, within the main memory 904, the static memory 906, and/or the processor 902 during execution thereof by the computer system 900, with the main memory 904 and the processor 902 also constituting machine-readable media.
- the instructions 924 may relate to the operations of an operating system (OS). Further, the instructions 924 may relate to operations performed by applications (commonly known as "apps"), consistent with some embodiments.
- applications commonly known as "apps"
- One example of such an application is a mobile browser application that displays content, such as a web page or a user interface using a browser.
- machine-readable medium 922 is shown in an example embodiment to be a single medium, the term “machine-readable medium” may include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more data structures or instructions 924.
- the term “machine -readable medium” shall also be taken to include any tangible medium that is capable of storing, encoding, or carrying instructions (e.g., instructions 924) for execution by the machine and that cause the machine to perform any one or more of the methodologies of the present disclosure, or that is capable of storing, encoding, or carrying data structures used by or associated with such instructions.
- machine- readable medium shall accordingly be taken to include, but not be limited to, solid-state memories, and optical and magnetic media.
- Specific examples of machine-readable media include non- volatile memory, including by way of example semiconductor memory devices (e.g., erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM)) and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD- ROM disks.
- semiconductor memory devices e.g., erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM)
- flash memory devices e.g., erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM)
- flash memory devices e.g., erasable programmable read-only memory (EPROM), electrically erasable programmable read-only
- the machine-readable medium is transitory in that it embodies a propagating signal.
- the instructions 924 may further be transmitted or received over a communications network 926 using a transmission medium.
- the instructions 924 may be transmitted using the network interface device 920 and any one of a number of well-known transfer protocols (e.g., HTTP). Examples of communication networks include a LAN, a WAN, the Internet, mobile telephone networks, POTS networks, and wireless data networks (e.g., WiFi and WiMax networks).
- the term "transmission medium” shall be taken to include any intangible medium that is capable of storing, encoding, or carrying the instructions 924 for execution by the machine, and includes digital or analog communications signals or other intangible media to facilitate communication of such software.
- a transmission medium is an embodiment of a machine readable medium.
- a method comprising: receiving a typed input from a user during a communication session; gathering context data corresponding to the input and the communication session;
- the context data may include one or more parameters, including a user transaction history, a user query history, a content of a website, and a content of the communication session.
- the text suggestion may be a word, phrase, numerical quantity, price term, or combination thereof;
- the user may accept and reject the text suggestion for use; and wherein the user may replace the text suggestion with a custom user input.
- the predictive typing suggestion may be generated while the two or more corresponding ontology are only partially loaded
- the corresponding ontology may be comprised of two or more ontology components; wherein the corresponding ontology and the two or more ontology components are dynamically loaded starting with a broadest ontology
- usage behavior is based on the keywords used from the corresponding ontology
- the accuracy of the predictive typing suggestion is calculated as the ratio of predictive typing suggestions rejected by the user against predictive typing suggestions accepted by the user;
- a system to dynamically load contextual ontologies comprising:
- a communications module configured to receive an input from a user during a communication session
- a context data module configured to gather context data corresponding to the received input from the user and the communication session
- an ontology database comprising ontologies
- an ontology module configured to retrieve a corresponding ontology from the ontology database based on the context data
- a predictive typing entry module configured to generate a predictive typing entry based on the context data, the received input, and the corresponding ontology, wherein the predictive typing entry generated by the predictive typing entry module is a text suggestion;
- a presentation module configured to present the predictive typing entry to the user.
- the ontology module is further configured to dynamically retrieve the corresponding ontology and the two or more ontology components, starting with a broadest ontology component, and providing additional narrow ontology components based on the context data and the received input.
- the rank is based on a frequency of use, a conversion rate, a usage behavior, and an accuracy of the text suggestions
- usage behavior is based on the keywords used from the corresponding ontology
- the accuracy of the predictive typing suggestion is calculated as the ratio of predictive typing suggestions rejected by the user against predictive typing suggestions accepted by the user.
- a machine-readable storage medium storing instructions that, when executed by a processor, causes the processor to perform a method to dynamically load contextual ontologies, the method comprising:
- the corresponding ontology may comprise two or more ontology components; wherein the method to dynamically load contextual ontologies further comprises: dynamically retrieving the corresponding ontology and the two or more ontology components, starting with a broadest ontology component, and providing additional narrow ontology components based on the context data and the input.
- a machine readable medium carrying machine readable instructions that, when executed by a processor, causes the processor to carry out the method of any one of examples 1 to 10.
- inventive subject matter may be referred to herein, individually and/or collectively, by the term "invention" merely for convenience and without intending to voluntarily limit the scope of this application to any single invention or inventive concept if more than one is in fact disclosed.
- inventive subject matter may be referred to herein, individually and/or collectively, by the term "invention" merely for convenience and without intending to voluntarily limit the scope of this application to any single invention or inventive concept if more than one is in fact disclosed.
- inventive subject matter merely for convenience and without intending to voluntarily limit the scope of this application to any single invention or inventive concept if more than one is in fact disclosed.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Computational Linguistics (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Human Computer Interaction (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Development Economics (AREA)
- Economics (AREA)
- General Business, Economics & Management (AREA)
- Life Sciences & Earth Sciences (AREA)
- Mathematical Physics (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Information Transfer Between Computers (AREA)
- User Interface Of Digital Computer (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
A system comprising a computer-readable storage medium storing at least one program and a computer-implemented method for generating a navigable user interface for the dynamic loading of contextual ontologies for predictive typing. In some embodiments, the method may include receiving an input from a client device, gathering context data corresponding to the input, and providing a predictive typing entry based on the context data and the received input, in a navigable user interface.
Description
DYNAMICALLY LOADING CONTEXTUAL ONTOLOGIES FOR
PREDICTIVE TYPING
REFERENCE TO RELATED APPLICATION
[0001] This application claims the benefit of priority of U.S. Patent Application No. 14/528,857, filed October 30, 2014, which is hereby
incorporated by reference in its entirety.
TECHNICAL FIELD
[0002] This application relates to data processing. In particular, example embodiments may relate to systems and methods for dynamically loading contextual ontologies for predictive touch screen typing.
BACKGROUND
[0003] As mobile devices increase in popularity, various applications and interfaces have been developed to broaden the applications in which mobile devices may be used. As a result, an increasing number of people may use mobile devices for purposes other than simply conducting phone calls.
However, because of frequent typographical errors (typos), and limited screen size, typing on mobile devices is often challenging. To remedy this, many mobile keyboards offer auto-complete suggestions for field entry as typing occurs. But these keyboard suggestions might not be applicable to a particular context in which a user is typing. When operating on a commerce site, for example, the words a user types are likely to relate to product names or features, with auto-complete suggestions being offered accordingly. The words may vary in different contexts, such as when composing a business email or texting a message to a friend.
BRIEF DESCRIPTION OF THE DRAWINGS
[0004] Various ones of the appended drawings merely illustrate example embodiments of the present inventive subject matter and cannot be considered as limiting its scope.
[0005] FIG. 1 is a network diagram depicting a network system having a client-server architecture configured for exchanging data over a network, according to an example embodiment.
[0006] FIG. 2 is a block diagram illustrating an example embodiment of multiple modules forming a contextual ontology application, which is provided as part of the network system of FIG. 1.
[0007] FIG. 3 is an interface diagram depicting an example communication session, consistent with some embodiments.
[0008] FIG. 4 is an interface diagram depicting further exchanges of the example communication session, consistent with some embodiments.
[0009] FIG. 5 is an interface diagram depicting further exchanges of the example communication session, consistent with some embodiments.
[0010] FIG. 6 is a flowchart illustrating an example method for providing a context based predictive typing entry, consistent with some example
embodiments.
[0011] FIG. 7 is a flowchart illustrating an example method of pre-caching an ontology and providing a context based predictive typing entry, consistent with some example embodiments.
[0012] FIG. 8 is a flowchart illustrating an example method for updating an ontology based on user input and context data, consistent with some example embodiments.
[0013] FIG. 9 is a diagrammatic representation of a machine in the example form of a computer system within which a set of instructions for causing the machine to perform any one or more of the methodologies discussed herein may be executed.
DETAILED DESCRIPTION
[0014] Reference will now be made in detail to specific example
embodiments for carrying out the inventive subject matter. Examples of these
specific embodiments are illustrated in the accompanying drawings. It will be understood that they are not intended to limit the scope of the claims to the described embodiments. On the contrary, they are intended to cover such alternatives, modifications, and equivalents as may be included within the scope of the disclosure. In the following description, specific details are set forth in order to provide a thorough understanding of the subject matter. Embodiments may be practiced without some or all of these specific details. In accordance with the present disclosure, components, process steps, and data structures may be implemented using various types of operating systems, programming languages, computing platforms, computer programs, and/or general purpose machines.
[0015] Aspects of the present disclosure describe systems and methods for dynamically loading contextual ontologies for predictive touch screen typing. The context may include information relating to the current or prior
communication session, or could be related to a transaction or query history of a user, the content of a website, or a word typed by the user. The context may also be highly granular— for example, when writing a listing for a car for sale, the contextual ontologies loaded for predictive typing may initially be specific to the category of cars, or even a particular type or model of car. If the user should then list a sofa for sale, a different contextual ontology may then be loaded. As used herein, a "user" or an "entity" may be a person (e.g., a human), a business (e.g., a company), an organization, a group of people, a persona (e.g., a fictitious character), a bot, or any combination thereof.
[0016] Context data representative of the context of the session may be automatically stored, consistent with some embodiments. In other embodiments, the method may include receiving user input, and in response to the user input, gathering the context data corresponding to the particular communication session, retrieving a corresponding ontology, presenting a predictive typing entry to the user based on the context data and the corresponding ontology, and updating the corresponding ontology based on the context data associated with the session and the user input.
[0017] The method may further include generating and causing the presentation of a text suggestion. In this manner, a user may be able to type on a
mobile device and receive text suggestions based on the entered text which may be relevant to the particular context of the communication session.
[0018] FIG. 1 is a network diagram depicting a network system 100, according to one embodiment, having a client-server architecture configured for exchanging data over a network. The network system 100 may include a network-based content publisher 102 in communication with a client device 106 and a third party server 114. In some example embodiments, the network-based content publisher 102 may be a network-based marketplace.
[0019] The network-based content publisher 102 may communicate and exchange data within the network system 100 that may pertain to various functions and aspects associated with the network system 100 and its users. The network-based content publisher 102 may provide server-side functionality, via a communication network 104 (e.g., the Internet), to one or more client devices (e.g., client device 106). The one or more client devices may be operated by users that use the network system 100 to exchange data over the communication network 104. These transactions may include transmitting, receiving
(communicating), and processing data to, from, and regarding content and users of the network system 100. The data may include, but are not limited to:
images; video or audio content; user preferences; product and service feedback, advice, and reviews; product, service, manufacturer, and vendor
recommendations and identifiers; product and service listings associated with buyers and sellers; product and service advertisements; auction bids; transaction data; and social data, among other things.
[0020] In various embodiments, the data exchanged within the network system 100 may be dependent upon user-selected functions available through one or more client or user interfaces (UIs). The UIs may be associated with a client device, such as the client device 106 using a web client 108. The web client 108 may be in communication with the network-based content publisher 102 via a web server 118. The UIs may also be associated with one or more applications 110 executing on the client device 106, such as a client application designed for interacting with the network-based content publisher 102, applications or services hosted by the network-based content publisher 102, or the third party server 114 (e.g., one or more servers or client devices) hosting a third party application 116.
[0021] The client device 106 may be any of a variety of types of devices. For example, the client device 106 may be a mobile device such as an iPhone® or other mobile device running the iOS® operating system, the Android® operating system, a BlackBerry® operating system, the Microsoft® Windows® Phone operating system, Symbian® OS, or webOS® . Consistent with some embodiments, the client device 106 may alternatively be a tablet computer, such as an iPad® or other tablet computer running one of the aforementioned operating systems. In some embodiments, the client device 106 may also be a personal digital assistant (PDA), a personal navigation device (PND), a handheld computer, a desktop computer, a laptop or netbook, a set-top box (STB) such as provided by cable or satellite content providers, a wearable computing device such as glasses or a wristwatch, a multimedia device embedded in an
automobile, a Global Positioning System (GPS) device, a data enabled book reader, or a video game system console such as the Nintendo Wii®, the
Microsoft Xbox 360®, the Sony PlayStation 3®, or other video game system consoles.
[0022] The client device 106 may interface via a connection 112 with the communication network 104 (e.g., the Internet or a wide area network (WAN)). Depending on the form of the client device 106, any of a variety of types of connection 112 and communication networks 104 may be used. For example, the connection 112 may be a Code Division Multiple Access (CDMA) connection, a Global System for Mobile communications (GSM) connection, or another type of cellular connection. Such a connection 112 may implement any of a variety of types of data transfer technology, such as Single Carrier Radio Transmission Technology (lxRTT), Evolution-Data Optimized (EVDO) technology, General Packet Radio Service (GPRS) technology, Enhanced Data rates for GSM Evolution (EDGE) technology, or other data transfer technology (e.g., fourth generation wireless, 4G networks). When such technology is employed, the communication network 104 may include a cellular network that has a plurality of cell sites of overlapping geographic coverage, interconnected by cellular telephone exchanges. These cellular telephone exchanges may be coupled to a network backbone (e.g., the public switched telephone network (PSTN), a packet-switched data network, or other types of networks).
[0023] In another example, the connection 112 may be a Wireless Fidelity
(Wi-Fi, IEEE 802. l lx type) connection, a Worldwide Interoperability for Microwave Access (WiMAX) connection, or another type of wireless data connection. In such an embodiment, the communication network 104 may include one or more wireless access points coupled to a local area network (LAN), a WAN, the Internet, or another packet-switched data network. In yet another example, the connection 112 may be a wired connection, for example an Ethernet link, and the communication network 104 may be a LAN, a WAN, the Internet, or another packet-switched data network. Accordingly, a variety of different configurations are expressly contemplated.
[0024] FIG. 1 also illustrates the third party application 1 16 executing on the third party server 114 that may offer one or more services to users of the client device 106. The third party application 116 may have programmatic access to the network-based content publisher 102 via the programmatic interface provided by an application program interface (API) server 120. In some embodiments, the third party application 116 may be associated with any organization that may conduct transactions with or provide services to the users of the client device 106.
[0025] Turning specifically to the network-based content publisher 102, the API server 120 and the web server 118 are coupled to, and provide
programmatic and web interfaces respectively to, an application server 122. The application server 122 may further host a plurality of user accounts for users of the network-based content publisher 102, which may be stored in a database 130. As illustrated in FIG. 1, the application server 122 may also host a contextual ontology application 126, which may be configured to provide a predictive typing entry from a corresponding ontology for predictive text, based on the session context. Such predictive text may, for example, be presented on the client device 106.
[0026] As illustrated in FIG. 1, the application server 122 may be coupled via the API server 120 and the web server 118 to the communication network
104, for example, via wired or wireless interfaces. The application server 122 is, in turn, shown to be coupled to a database server 128 that facilitates access to the database 130. In some examples, the application server 122 can access the database 130 directly without the need for the database server 128. In some embodiments, the database 130 may include multiple databases that may be
internal or external to the network-based content publisher 102.
[0027] The database 130 may store data pertaining to various functions and aspects associated with the network system 100 and its users. For example, user accounts for users of the network-based content publisher 102 may be stored and maintained in the database 130. Each user account may comprise user data that describes aspects of a particular user. The user data may include demographic data, user preferences, and financial information. The demographic data may, for example, include information describing one or more characteristics of a user. Demographic data may, for example, include gender, age, location information, employment history, education history, contact information, familial relations, or user interests. The financial information may, for example, include private financial information of the user such as account number, credential, password, device identifier, user name, phone number, credit card information, bank information, transaction history or other financial information which may be used to facilitate online transactions by the user. Consistent with some embodiments, the transaction history may include information related to transactions for items or services (collectively referred to as "products") that may be offered for sale by merchants using marketplace services provided by the network-based content publisher 102. The transaction history information may, for example, include a description of a product purchased by the user, an identifier of the product, a category to which the product belongs, a purchase price, a quantity, or a number of bids.
[0028] The user data may also include a record of user activity, consistent with some embodiments. Each user session may be stored in the database 130 as session data, and such session data may be maintained as part of the user data about each user. Accordingly, in some embodiments, the user data may include past keyword searches that users have performed, web pages viewed by each user, products added to a user wish list or watch list, products added to an electronic shopping cart, and products that the users own. User preferences may be inferred from the user activity.
[0029] While the marketplace application 124 and the contextual ontology application 126 are shown in FIG. 1 to both form part of the network-based content publisher 102, it will be appreciated that, in alternative embodiments, the contextual ontology application 126 may form part of a service that is separate
and distinct from the network-based content publisher 102. Further, while the network system 100 shown in FIG. 1 employs a client-server architecture, the present inventive subject matter is, of course, not limited to such an architecture, and could equally well find application in an event-driven, distributed, or peer- to-peer architecture system, for example. The various modules of the
application server 122 may also be implemented as standalone systems or software programs, which do not necessarily have networking capabilities. It shall be appreciated that although the various functional components of the network system 100 are discussed in the singular sense, multiple instances of one or more of the various functional components may be employed.
[0030] FIG. 2 is a block diagram illustrating an example embodiment of multiple modules forming the contextual ontology application 126, which is provided as part of the network-based content publisher 102. The contextual ontology application 126 is shown as including a communication module 200, a context data module 204, an ontology retrieval module 206, a predictive typing entry module 208, a presentation module 210, and an ontology database 202, all configured to communicate with each other (e.g., via a bus, shared memory, a switch, or application programming interfaces (APIs)). The various modules of the contextual ontology application 126 may access the databases 130 via the database server 128, and each of the various modules of the contextual ontology application 126 may be in communication with one or more of the third party applications 116. Further, the various modules of the contextual ontology application 126 may access a machine-readable memory of the client device 106.
[0031] Consistent with some embodiments, the communication module 200 may be configured to receive user input generated by one or more input/output (I/O) devices that may be included with or communicatively coupled to the client device 106. Depending on the form of the client device 106, the I/O devices may, for example, be a mouse, a track pad, a keypad, a keyboard, a multi-touch sensing surface (e.g., a touchscreen or trackpad), a microphone, a speaker, a camera, and the like. The user input may be received by one of the aforementioned I/O devices and, in some embodiments, transmitted to the application server 122 for receipt by the communication module 200.
[0032] The ontology database 202 may be configured to store one or more contextual ontologies which may be accessed by the ontology retrieval module
206. In some embodiments, ontologies in the ontology database may be defined as compositions of two or more increasingly specific ontology components. For example, an ontology related to "Cars" may be composed of multiple increasingly narrow ontology components, such as an ontology representing "American Cars," an ontology representing "American Cars made by
Chevrolet," and so on.
[0033] The context data module 204 may be configured to capture and store context data that is representative of a communication session and may be used to recall the content of the communication session at a later time. Context data refers to the content of a particular web site or application environment accessed by one or more applications 110 executing on a client device (e.g., client device 106). Example context data includes elements that describe the content and subject of a particular communication session, a user transaction history, a user query history, or actions performed by a user when conducting an online transaction, completing an online form, taking an online survey, writing an email, and creating a listing.
[0034] The context data may include interactions of the client device 106 with the application server 122, such as information provided by a user, buttons (or other visual indicators) activated by the user, an identification of steps completed by the user, keystrokes, cursor and pointer movements, actions canceled by the user, and other types of clickstream data. Accordingly, the context data module 204 may be configured to monitor, track, and record the activities and interactions of a user, using one or more devices (e.g., client device 106), with the various modules of the network system 100.
[0035] The ontology retrieval module 206 may be configured to retrieve a corresponding ontology from the ontology database 202, based on the context of a communication session. In some embodiments, the user may manually specify a particular ontology to use through a user interface. The corresponding ontology provided to the user will then allow the predictive typing entry module 208 to generate more relevant and accurate predictive typing entries, based on the corresponding context data.
[0036] In some embodiments, the ontology retrieval module 206 may also be configured to regularly create ontologies to populate the ontology database 202.
For example, the ontology retrieval module 206 may regularly receive context
data from a website or online marketplace. The ontology retrieval module may then use the gathered context data to create up to date and relevant ontology which may then be delivered to the predictive typing entry module 208 in order to create a predictive typing entry for the user.
[0037] The ontology retrieval module 206 may be further configured to pre- cache a corresponding ontology based on a user history as well as the context data. The user history may include information related to previous listings created by the user, such as item attributes, location attributes, and pricing information. In some embodiments, the ontology retrieval module 206 may also assign a rank to the corresponding ontology, and then select the corresponding ontology based on the relative rank with a particular user. The assigned rank may be based on relevance to a particular context, total usage by a particular user, or frequency of use overall, or usage behavior. In other embodiments, the assigned rank may be based on a conversion rate, or return on investment associated with a particular ontology, wherein a higher conversion rate or return on investment corresponds with a higher ranking among the other ontology within the ontology database 202. A conversion rate is defined as the percentage of visitors to a particular website who complete a goal, as set by the site owner.
[0038] The ontology retrieval module 206 may be further configured to create a new ontology based upon user input and user behavior. For example, a user may regularly use a particular word or phrase in conjunction with a particular context. The ontology retrieval module 206 may therefore assemble a corresponding ontology for the unique context, and store the ontology in the ontology database 202. In further embodiments, the ontology retrieval module 206 may also update the new ontology based on the real-time user inputs. In further embodiments. The ontology retrieval module 206 may further be configured to update the corresponding ontology based on the user inputs and context data. In doing so, the ontology may accurately correspond to a particular user's needs.
[0039] In some embodiments, the ontology retrieval module 206 may be configured to dynamically retrieve an ontology as the context data module 204 collects corresponding context data. In other embodiments, the ontology retrieval module 206 may be further configured to retrieve increasingly narrow ontologies from the ontology database 202. In even further embodiments, the
ontology retrieval module 204 may be configured to retrieve two or more corresponding ontology, including a baseline ontology and a category specific ontology, so that the keywords, text predictions, and sequences that are generic don't have to be loaded again.
[0040] In other embodiments, the ontology retrieval module 206 may be configured to retrieve and stream an ontology to the user, starting with the most frequently used keywords within the corresponding ontology. For example, upon selecting an ontology for use based on the context data, the ontology retrieval module 206 may stream the most frequently used keywords by the user from with that corresponding ontology, ensuring that predictive typing entry module 208 can begin generating predictive typing suggestions immediately.
[0041] The predictive typing entry module 208 may be configured to provide a predictive typing entry based on one or more parameters in conjunction with the corresponding ontology retrieved by the ontology retrieval module 206. In some embodiments, the parameters may include the received user input, a user history, and context data surrounding the particular communication session. The predicted text may be in the form of words or phrases, or in further embodiments be a predicted price range, location prediction, or time frame, based on the context data. In one example embodiment consistent with some embodiments, if a user is listing a pair of Ray-Ban sunglasses for sale, the predictive typing entry module 208 may provide the user with text suggestions which may not otherwise be suggested outside of that particular context, such as for words and phrases which are most commonly used in conjunction with sunglasses, or even more specifically, Ray-Ban sunglasses. In further embodiments, the predictive typing entry module 208 may also suggest a price range or time limit for the listing based on other similar listings for similar sunglasses.
[0042] The presentation module 210 may be configured to present the text suggestion from the predictive typing entry module 208 to the user. In some embodiments, the text suggestion may be provided to the user as a user selectable option, which the user can choose to accept or deny. In further embodiments, the presentation module 210 may present two or more predictive typing entries to the user, from which the user may select.
[0043] After the user has selected or rejected a suggested predictive typing entry, the presentation module 210 may respond by communicating the response
to the predictive typing entry module 208. The predictive typing entry module 208 may then determine whether the particular ontology selected by the ontology retrieval module 206 is accurate for the particular context. In some embodiments, the predictive typing entry module 208 may then query the ontology retrieval module 206 for a different ontology, or may update the ontology with information from the particular context in order to create more accurate ontologies for future use.
[0044] FIG. 3 is an interface diagram depicting an example communication session, consistent with some embodiments. The first client device illustrated in
FIG. 3 may correspond to the client device 106 of FIG. 1. As illustrated in FIG.
3, the example communication session may include a user input 302, input by a user on an interface displayed on the client device 106 through a keyboard 308, which may be transmitted as a request to the application server 122.
[0045] As illustrated, the user input 302 may be a search request in an online marketplace application, which may generate search results 306. In some example embodiments, a user typing the user input 302 may be provided with a contextual text suggestion 304 based on a corresponding ontology, the user input
302, context data, and the user history. The context data may include information specific to a particular category, item type, or web site content, as well as the subject matter of the user input 302 itself. The user history may include information corresponding to a particular user, such as user profile information, previous search requests, a transaction history, and user selected preferences. For example, consistent with some example embodiments, the user may begin typing a search query using the communication module 200. In response to the entry, the context data module 204 may gather corresponding context information, as well as information associated with the user history and the user input, which it may then provide to the ontology retrieval module 206.
Once the ontology retrieval module 206 receives the context data, a
corresponding ontology may be provided to the predictive typing entry module
208, in order to provide the user with an accurate, contextual predictive typing entry. The ontology retrieval module 206 may store and retrieve ontologies in the ontology database 202. Once a corresponding ontology has been selected by the ontology retrieval module 206, the predictive typing entry module 208 may use the corresponding ontology to generate the contextual text suggestions 304.
The contextual text suggestions 304 may then be provided to the presentation module 210, which presents the contextual text suggestions 304 to the user.
[0046] In some example embodiments, the presentation module 210 may provide the user with a single contextual text suggestion 304; however, in other embodiments the presentation module 210 may present two or more contextual text suggestions 304, from which a user may select. Upon the user selecting a suggestion, the presentation module may respond by providing the selection to the context data module 204, in order to refine the ontology to better fit the specific context.
[0047] Turning our attention to FIG. 4, an interface diagram depicting a user entering details for a listing in an online marketplace, consistent with some embodiments, is illustrated. As shown, the user may wish to fill in relevant details related to the posting in a detail field 406. In some example
embodiments, the contextual ontology application 126 may be configured to provide a user with a text suggestion 408. The text suggestion 408 may be based upon the context and parameters of a listing 402, such as an image 404 which represents the item, as well as a listing title 410. The context data module 204 may be configured to recognize context data from a corresponding image. For example, a user may upload or otherwise provide an image 404 which may identify a particular item to be used in a listing. The context data module 204 may then identify the image and deliver the associated data to the ontology retrieval module 206, which may then retrieve a corresponding ontology based on the image 404. The contextual ontology application 126 may then provide the user with the text suggestion 408, which the user may then decide whether or not to use through selection.
[0048] In further embodiments, the contextual ontology application 126 may be configured to dynamically provide a user with increasingly specific ontologies as more context data is gathered by the context data module 204. For example, once the context data module 204 identifies that the image 404 represents a pair of sunglasses, a corresponding ontology for sunglasses may be provided to the user to generate relevant text suggestions. As the user types and adds detail to the listing, for example by adding a listing title 410 which specifies a brand or type of sunglasses, the context data module 204 may dynamically identify these relevant attributes, and provide the user with a
narrower ontology, for example an ontology corresponding to Ray-Ban sunglasses specifically. As the user continues to add details to the context of the listing, the context data module 204 will continue to dynamically identify and provide the data to the ontology retrieval module 206, in order to provide the user with the most relevant ontology or ontologies possible.
[0049] FIG. 5 illustrates an interface diagram of an example scenario in which a user wishes to add price information 502 to a listing in an online marketplace. In some example embodiments, the contextual ontology application 126 may also be configured to provide a user with a price suggestion 504. For example, the context data module 204 may recognize that a user is creating a listing in an online marketplace, based on relevant context data. The context data module 204 may then collect pricing information relevant to the current listing by retrieving pricing information for other similar listings, or from the user's prior transaction history. The presentation module 210 may then present the price suggestions 504 to the user, for user selection.
[0050] FIG. 6 is a flowchart illustrating an example method 600 for providing a predictive typing entry to a user based on the context data, the received input, and the corresponding ontology. The method 600 may be embodied in computer-readable instructions for execution by one or more processors such that the steps of the method 600 may be performed in part or in whole by the application server 122 or the client device 106, and in particular the modules 200-210 comprising the contextual ontology application 126.
[0051] At operation 605, the communication module 200 may receive a user input. In response to the user input, the context data module 204 may gather context data corresponding to the input at operation 610. The context data module 204 may then deliver the context data to the ontology retrieval module 206. Upon receiving the context data, at operation 615, the ontology retrieval module 206 may select a corresponding ontology stored in the ontology database 202. The ontology retrieval module 206 may then provide the corresponding ontology to the predictive typing entry module 208. In some embodiments, the ontology retrieval module 206 may stream the corresponding ontology to the user. In further embodiments, the ontology retrieval module 206 may stream two or more corresponding ontology to the user, such that the ontology may be combined to form a larger more comprehensive ontology.
[0052] At operation 620, the predictive typing entry module 208 may use the corresponding ontology and the context data to provide the user with a text suggestion through the presentation module 210. Upon receiving the text suggestion from the presentation module 210, the user may choose to select the suggestion, or ignore it. In some embodiments, the predictive typing entry module 208 may begin generating predictive typing entry while the
corresponding ontology is only partially streamed.
[0053] FIG. 7 is a flowchart illustrating a method 700 by which the contextual ontology application 126 may pre-cache a corresponding ontology before receiving a user input. At operation 705, the contextual ontology application 126 may pre-cache an ontology based on a user history. The user history may include a user's transaction history, previous listings a user has viewed or created, a user's search query history, and the ontology most often used by a user. The communication module 200 may then receive an input from a user at operation 710. At operation 715, in response to the user input, the predictive typing entry module 208 may immediately provide the user with text suggestions based on the received input and the pre-cached ontology, which the user may choose to accept or reject.
[0054] At operation 720, the context data module 204 may gather context data corresponding to the user input. The context data module 204 may then provide the context data to the ontology retrieval module 206. At operation 725, the ontology retrieval module 206 may then provide a narrower and more specific ontology to the predictive typing entry module 208, based on the user input, the pre-cached ontology, and the context data gathered by the context data module 204. At operation 730, a predictive typing entry may be provided by the predictive typing entry module 208 and the presentation module 210.
[0055] FIG. 8 illustrates a method 800 for updating an ontology within the ontology database 202 with user input data. The user input data can include information associated with the text inputs and accepted or rejected predictive typing entry suggestions. For example, a user may reject a particular text suggestion provided by the predictive typing entry module 208. As a result, the contextual ontology application 126 may update the corresponding ontology to eliminate a particular text suggestion in the given context. In further example embodiments, the contextual ontology application 126 may update the
corresponding ontology to include the text input which the user provides in the place of the suggestion. In this way, the ontology may be regularly updated with relevant information corresponding to a particular context.
[0056] At operation 805, the communication module 200 may receive a user input. In response, at operation 810, the context data module 204 may gather context data corresponding to the input. The context data module 204 may then deliver the context data to the ontology retrieval module 206. Upon receiving the context data, at operation 815, the ontology retrieval module 206 may select a corresponding ontology stored in the ontology database 202. The ontology retrieval module 206 may then provide the corresponding ontology to the predictive typing entry module 208. At operation 820, the predictive typing entry module 208 may then generate a text suggestion and deliver the suggestion to the presentation module 210, which may then provide the suggestion to the user. The user may then choose to accept and use the suggested text, or alternatively in some embodiments may reject the suggestion and provide their own input text. At operation 825, the ontology retrieval module 206 may update the corresponding ontology based on the user's response to the suggestion. For example, should the user accept the suggestion, the ontology retrieval module 206 may update the corresponding ontology by increasing its rank in relation to other ontologies. However, should the user reject the suggestion and provide input text, the ontology retrieval module 126 may demote the rank of the corresponding ontology, and may also add the provided input text from the user to the ontology for future use.
[0057] In further embodiments, the ontology retrieval module 206 may also create new ontology, based on the typed inputs of the user. The ontology retrieval module 206 may create a new ontology based on the typed input, and update the new ontology with suggested keywords provided to the user realtime.
MODULES, COMPONENTS AND LOGIC
[0058] Certain embodiments are described herein as including logic or a number of components, modules, or mechanisms. Modules may constitute either software modules (e.g., code embodied on a machine-readable medium or in a transmission signal) or hardware modules. A hardware module is a tangible unit
capable of performing certain operations and may be configured or arranged in a certain manner. In example embodiments, one or more computer systems (e.g., a standalone, client, or server computer system) or one or more hardware modules of a computer system (e.g., a processor or a group of processors) may be configured by software (e.g., an application or application portion) as a hardware module that operates to perform certain operations as described herein.
[0059] In various embodiments, a hardware module may be implemented mechanically or electronically. For example, a hardware module may comprise dedicated circuitry or logic that is permanently configured (e.g., as a special- purpose processor, such as a field-programmabe gate array (FPGA) or an application-specific integrated circuit (ASIC)) to perform certain operations. A hardware module may also comprise programmable logic or circuitry (e.g., as encompassed within a general-purpose processor or other programmable processor) that is temporarily configured by software to perform certain operations. It will be appreciated that the decision to implement a hardware module mechanically, in dedicated and permanently configured circuitry, or in temporarily configured circuitry (e.g., configured by software) may be driven by cost and time considerations.
[0060] Accordingly, the term "hardware module" should be understood to encompass a tangible entity, be that an entity that is physically constructed, permanently configured (e.g., hardwired) or temporarily configured (e.g., programmed) to operate in a certain manner and/or to perform certain operations described herein. Considering embodiments in which hardware modules are temporarily configured (e.g., programmed), each of the hardware modules need not be configured or instantiated at any one instance in time. For example, where the hardware modules comprise a general-purpose processor configured using software, the general-purpose processor may be configured as respective different hardware modules at different times. Software may accordingly configure a processor, for example, to constitute a particular hardware module at one instance of time and to constitute a different hardware module at a different instance of time.
[0061] Hardware modules can provide information to, and receive information from, other hardware modules. Accordingly, the described hardware modules may be regarded as being communicatively coupled. Where
multiple of such hardware modules exist contemporaneously, communications may be achieved through signal transmission (e.g., over appropriate circuits and buses that connect the hardware modules). In embodiments in which multiple hardware modules are configured or instantiated at different times,
communications between such hardware modules may be achieved, for example, through the storage and retrieval of information in memory structures to which the multiple hardware modules have access. For example, one hardware module may perform an operation and store the output of that operation in a memory device to which it is communicatively coupled. A further hardware module may then, at a later time, access the memory device to retrieve and process the stored output. Hardware modules may also initiate communications with input or output devices, and can operate on a resource (e.g., a collection of information).
[0062] The various operations of example methods described herein may be performed, at least partially, by one or more processors that are temporarily configured (e.g., by software) or permanently configured to perform the relevant operations. Whether temporarily or permanently configured, such processors may constitute processor-implemented modules that operate to perform one or more operations or functions. The modules referred to herein may, in some example embodiments, comprise processor-implemented modules.
[0063] Similarly, the methods described herein may be at least partially processor-implemented. For example, at least some of the operations of a method may be performed by one or more processors or processor-implemented modules. The performance of certain of the operations may be distributed among the one or more processors, not only residing within a single machine, but deployed across a number of machines. In some example embodiments, the processor or processors may be located in a single location (e.g., within a home environment, an office environment, or a server farm), while in other
embodiments the processors may be distributed across a number of locations.
[0064] The one or more processors may also operate to support performance of the relevant operations in a "cloud computing" environment or as a "software as a service" (SaaS). For example, at least some of the operations may be performed by a group of computers (as examples of machines including processors), with these operations being accessible via a network (e.g., the Internet) and via one or more appropriate interfaces (e.g., APIs).
ELECTRONIC APPARATUS AND SYSTEM
[0065] Example embodiments may be implemented in digital electronic circuitry, or in computer hardware, firmware, or software, or in combinations of them. Example embodiments may be implemented using a computer program product, for example, a computer program tangibly embodied in an information carrier, for example, in a machine-readable medium for execution by, or to control the operation of, data processing apparatus, for example, a
programmable processor, a computer, or multiple computers.
[0066] A computer program can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a standalone program or as a module, subroutine, or other unit suitable for use in a computing environment. A computer program can be deployed to be executed on one computer or on multiple computers at one site, or distributed across multiple sites and interconnected by a communication network.
[0067] In example embodiments, operations may be performed by one or more programmable processors executing a computer program to perform functions by operating on input data and generating output. Method operations can also be performed by, and apparatus of example embodiments may be implemented as, special purpose logic circuitry (e.g., an FPGA or an ASIC).
[0068] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client- server relationship to each other. In embodiments deploying a programmable computing system, it will be appreciated that both hardware and software architectures merit consideration. Specifically, it will be appreciated that the choice of whether to implement certain functionality in permanently configured hardware (e.g., an ASIC), in temporarily configured hardware (e.g., a combination of software and a programmable processor), or in a combination of permanently and temporarily configured hardware may be a design choice. Below are set out hardware (e.g., machine) and software architectures that may be deployed, in various example embodiments.
EXAMPLE MACHINE ARCHITECTURE AND MACHINE-READABLE MEDIUM
[0069] FIG. 9 is a diagrammatic representation of a machine in the example form of a computer system 900 within which a set of instructions 924 for causing the machine to perform any one or more of the methodologies discussed herein may be executed. The computer system 900 may correspond to the client device 106, the third party server 114, or the application server 122, consistent with some embodiments. In alternative embodiments, the machine operates as a standalone device or may be connected (e.g., networked) to other machines. In a networked deployment, the machine may operate in the capacity of a server or a client machine in a server-client network environment, or as a peer machine in a peer-to-peer (or distributed) network environment. The machine may be a personal computer (PC), a tablet PC, a set-top box (STB), a PDA, a cellular telephone, a smart phone (e.g., iPhone® ), a tablet computer, a web appliance, a network router, switch, or bridge, or any machine capable of executing instructions (sequential or otherwise) that specify actions to be taken by that machine. Further, while only a single machine is illustrated, the term "machine" shall also be taken to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.
[0070] The example computer system 900 includes a processor 902 (e.g., a central processing unit (CPU), a graphics processing unit (GPU), or both), a main memory 904, and a static memory 906, which communicate with each other via a bus 908. The computer system 900 may further include a video display unit 910 (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)). The computer system 900 also includes one or more input/output (I/O) devices 912, a location component 914, a disk drive unit 916, a signal generation device 918 (e.g., a speaker), and a network interface device 920. The I/O devices 912 may, for example, include a keyboard, a mouse, a keypad, a multi- touch surface (e.g., a touchscreen or track pad), a microphone, a camera, and the like.
[0071] The location component 914 may be used for determining a location of the computer system 900. In some embodiments, the location component 914
may correspond to a GPS transceiver that may make use of the network interface device 920 to communicate GPS signals with a GPS satellite. The location component 914 may also be configured to determine a location of the computer system 900 by using an internet protocol (IP) address lookup or by triangulating a position based on nearby mobile communications towers. The location component 914 may be further configured to store a user-defined location in the main memory 904 or the static memory 906. In some embodiments, a mobile location enabled application may work in conjunction with the location component 914 and the network interface device 920 to transmit the location of the computer system 900 to an application server or third party server for the purpose of identifying the location of a user operating the computer system 900.
[0072] In some embodiments, the network interface device 920 may correspond to a transceiver and antenna. The transceiver may be configured to both transmit and receive cellular network signals, wireless data signals, or other types of signals via the antenna, depending on the nature of the computer system 900.
MACHINE-READABLE MEDIUM
[0073] The disk drive unit 916 includes a machine-readable medium 922 on which is stored one or more sets of data structures and instructions 924 (e.g., software) embodying or used by any one or more of the methodologies or functions described herein. The instructions 924 may also reside, completely or at least partially, within the main memory 904, the static memory 906, and/or the processor 902 during execution thereof by the computer system 900, with the main memory 904 and the processor 902 also constituting machine-readable media.
[0074] Consistent with some embodiments, the instructions 924 may relate to the operations of an operating system (OS). Further, the instructions 924 may relate to operations performed by applications (commonly known as "apps"), consistent with some embodiments. One example of such an application is a mobile browser application that displays content, such as a web page or a user interface using a browser.
[0075] While the machine-readable medium 922 is shown in an example embodiment to be a single medium, the term "machine-readable medium" may
include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more data structures or instructions 924. The term "machine -readable medium" shall also be taken to include any tangible medium that is capable of storing, encoding, or carrying instructions (e.g., instructions 924) for execution by the machine and that cause the machine to perform any one or more of the methodologies of the present disclosure, or that is capable of storing, encoding, or carrying data structures used by or associated with such instructions. The term "machine- readable medium" shall accordingly be taken to include, but not be limited to, solid-state memories, and optical and magnetic media. Specific examples of machine-readable media include non- volatile memory, including by way of example semiconductor memory devices (e.g., erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM)) and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD- ROM disks.
[0076] Furthermore, in one embodiment, the machine-readable medium is transitory in that it embodies a propagating signal.
TRANSMISSION MEDIUM
[0077] The instructions 924 may further be transmitted or received over a communications network 926 using a transmission medium. The instructions 924 may be transmitted using the network interface device 920 and any one of a number of well-known transfer protocols (e.g., HTTP). Examples of communication networks include a LAN, a WAN, the Internet, mobile telephone networks, POTS networks, and wireless data networks (e.g., WiFi and WiMax networks). The term "transmission medium" shall be taken to include any intangible medium that is capable of storing, encoding, or carrying the instructions 924 for execution by the machine, and includes digital or analog communications signals or other intangible media to facilitate communication of such software. In one embodiment, a transmission medium is an embodiment of a machine readable medium.
[0078] The following numbered examples are embodiment.
[0079] 1. A method comprising:
receiving a typed input from a user during a communication session; gathering context data corresponding to the input and the communication session;
retrieving a corresponding ontology, from a database of ontologies, based on the context data, wherein the ontologies comprise keywords for use in generating a predictive typing entry; and
providing the predictive typing entry based on the input, the context data and the corresponding ontology.
[0080] 2. The method of example 1, wherein the context data may include one or more parameters, including a user transaction history, a user query history, a content of a website, and a content of the communication session.
[0081] 3. The method of example 1 or example 2, further comprising communicating the predictive typing entry as a text suggestion;
wherein the text suggestion may be a word, phrase, numerical quantity, price term, or combination thereof;
wherein the user may accept and reject the text suggestion for use; and wherein the user may replace the text suggestion with a custom user input.
[0082] 4. The method of any one of examples 1 to 3, wherein the communication session includes a first time period and a second time period, and wherein the method further comprises:
receiving a first typed input from a user during the first period in a communication session;
gathering first context data corresponding to the first typed input and the first period in the communication session;
retrieving a first corresponding ontology, from the database of ontologies, based on the first context data;
providing the predictive typing entry based on the first typed input, the first context data and the first corresponding ontology;
receiving a second typed input from the user during the second time period in the communication session;
gathering second context data corresponding to the second typed input and the second period in the communication session;
retrieving a second corresponding ontology, from the database of
ontologies, based on the second context data; and
providing the predictive typing entry based on the second typed input, the second context data and the second corresponding ontology.
[0083] 5. The method of any one of examples 1 to 4, further comprising the user saving the corresponding ontology locally; and
recalling the corresponding ontology automatically.
[0084] 6. The method of any one of examples 1 to 5, further comprising regularly creating a new ontology, based on the context data and the user input; storing the new ontology are stored in the database of ontologies; and updating the new ontology with a subsequent related user input, wherein the subsequent related user input corresponds with the context data and the user input.
[0085] 7. The method of any one of examples 1 to 6, wherein two or more ontology may be streamed to the user, wherein the two or more ontology includes a baseline ontology and a category specific ontology;
wherein the most frequently used keywords of the corresponding ontology are streamed to the user first;
wherein the two or more corresponding ontology are used to generate the predictive typing suggestion; and
wherein the predictive typing suggestion may be generated while the two or more corresponding ontology are only partially loaded,
[0086] 8. The method of any one of examples 1 to 7, wherein the corresponding ontology may be comprised of two or more ontology components; wherein the corresponding ontology and the two or more ontology components are dynamically loaded starting with a broadest ontology
component, and providing additional narrower ontology components based on the context data and the input.
[0087] 9. The method of any one of examples 1 to 8, further comprising: assigning a rank to the corresponding ontology based on a frequency of use, a conversion rate, a usage behavior, and an accuracy of the text suggestions; wherein the frequency of use is the total number of times the
corresponding ontology is used by the user, as compared with other ontologies in the database of ontologies;
wherein a higher conversion rate corresponds to a higher overall rank
within the database of ontologies;
wherein the usage behavior is based on the keywords used from the corresponding ontology; and
wherein the accuracy of the predictive typing suggestion is calculated as the ratio of predictive typing suggestions rejected by the user against predictive typing suggestions accepted by the user; and
pre-caching the corresponding ontology with the highest assigned rank with the user.
[0088] 10. The method of example 2, further comprising pre-caching the corresponding ontology based on a previous context data associated with a previous communication session, the user transaction history, and the user query history.
[0089] 11. A system to dynamically load contextual ontologies comprising:
a communications module, configured to receive an input from a user during a communication session;
a context data module, configured to gather context data corresponding to the received input from the user and the communication session;
an ontology database comprising ontologies;
an ontology module, configured to retrieve a corresponding ontology from the ontology database based on the context data;
a predictive typing entry module, configured to generate a predictive typing entry based on the context data, the received input, and the corresponding ontology, wherein the predictive typing entry generated by the predictive typing entry module is a text suggestion; and
a presentation module, configured to present the predictive typing entry to the user.
[0090] 12. The system of example 11, wherein the corresponding ontology may comprise two or more ontology components;
[0091] wherein the ontology module is further configured to dynamically retrieve the corresponding ontology and the two or more ontology components, starting with a broadest ontology component, and providing additional narrow ontology components based on the context data and the received input.
[0092] 13. The system of example 11 or 12, wherein the communications
module is further configured to receive a user input to accept the text suggestion; and
receive a user input to reject the text suggestion.
[0093] 14. The system of any one of examples 11 to 13, wherein the ontology module is further configured to assign a rank to the corresponding ontology;
wherein the rank is based on a frequency of use, a conversion rate, a usage behavior, and an accuracy of the text suggestions;
wherein the frequency of use is the total number of times the
corresponding ontology is used by the user, as compared with other ontologies in the database of ontologies;
wherein a higher conversion rate corresponds to a higher overall rank within the database of ontologies;
wherein the usage behavior is based on the keywords used from the corresponding ontology; and
wherein the accuracy of the predictive typing suggestion is calculated as the ratio of predictive typing suggestions rejected by the user against predictive typing suggestions accepted by the user.
[0094] 15. The system of any one of examples 11 to 14, wherein the ontology module is further configured to pre-cache the corresponding ontology.
[0095] 16. A machine-readable storage medium storing instructions that, when executed by a processor, causes the processor to perform a method to dynamically load contextual ontologies, the method comprising:
receiving an input from a user during a communication session;
gathering context data corresponding to the input and the communication session;
retrieving a corresponding ontology from an ontology database based on the context data; and
generating a predictive typing entry based on the input, the context data and the corresponding ontology.
[0096] 17. The machine-readable storage medium of example 16 , wherein the corresponding ontology may comprise two or more ontology components; wherein the method to dynamically load contextual ontologies further comprises:
dynamically retrieving the corresponding ontology and the two or more ontology components, starting with a broadest ontology component, and providing additional narrow ontology components based on the context data and the input.
[0097] 18. The machine-readable storage medium of example 16 or 17, wherein the predictive typing entry is a text suggestion which may be accepted or rejected by the user.
[0098] 19. The machine-readable storage medium of any one of examples 16 to 18, wherein the method to dynamically load contextual ontologies further comprises:
pre-caching the corresponding ontology.
[0099] 20. The machine-readable storage medium of any one of examples 16 to 19, wherein the method to dynamically load contextual ontologies further comprises:
assigning a rank to the corresponding ontology.
[00100] 21. A machine readable medium carrying machine readable instructions that, when executed by a processor, causes the processor to carry out the method of any one of examples 1 to 10.
[00101] Although the embodiments of the present inventive subject matter have been described with reference to specific example embodiments, it will be evident that various modifications and changes may be made to these
embodiments without departing from the broader scope of the inventive subject matter. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense. The accompanying drawings that form a part hereof show by way of illustration, and not of limitation, specific embodiments in which the subject matter may be practiced. The embodiments illustrated are described in sufficient detail to enable those skilled in the art to practice the teachings disclosed herein. Other embodiments may be used and derived therefrom, such that structural and logical substitutions and changes may be made without departing from the scope of this disclosure. This Detailed Description, therefore, is not to be taken in a limiting sense, and the scope of various embodiments is defined only by the appended claims, along with the full range of equivalents to which such claims are entitled.
[00102] Such embodiments of the inventive subject matter may be referred to
herein, individually and/or collectively, by the term "invention" merely for convenience and without intending to voluntarily limit the scope of this application to any single invention or inventive concept if more than one is in fact disclosed. Thus, although specific embodiments have been illustrated and described herein, it should be appreciated that any arrangement calculated to achieve the same purpose may be substituted for the specific embodiments shown. This disclosure is intended to cover any and all adaptations or variations of various embodiments. Combinations of the above embodiments, and other embodiments not specifically described herein, will be apparent to those of skill in the art upon reviewing the above description.
[00103] All publications, patents, and patent documents referred to in this document are incorporated by reference herein in their entirety, as though individually incorporated by reference. In the event of inconsistent usages between this document and those documents so incorporated by reference, the usage in the incorporated references should be considered supplementary to that of this document; for irreconcilable inconsistencies, the usage in this document controls.
[00104] In this document, the terms "a" or "an" are used, as is common in patent documents, to include one or more than one, independent of any other instances or usages of "at least one" or "one or more." In this document, the term "or" is used to refer to a nonexclusive or, such that "A or B" includes "A but not B," "B but not A," and "A and B," unless otherwise indicated. In the appended claims, the terms "including" and "in which" are used as the plain- English equivalents of the respective terms "comprising" and "wherein." Also, in the following claims, the terms "including" and "comprising" are open-ended; that is, a system, device, article, or process that includes elements in addition to those listed after such a term in a claim are still deemed to fall within the scope of that claim. Moreover, in the following claims, the terms "first," "second," "third," and so forth are used merely as labels, and are not intended to impose numerical requirements on their objects.
Claims
1. A method comprising:
receiving a typed input from a user during a communication session;
gathering context data corresponding to the input and the communication session;
retrieving a corresponding ontology, from a database of ontologies, based on the context data, wherein the ontologies comprise keywords for use in generating a predictive typing entry; and
providing the predictive typing entry based on the input, the context data and the corresponding ontology.
2. The method of claim 1 , wherein the context data may include one or more parameters, including a user transaction history, a user query history, a content of a website, and a content of the communication session.
3. The method of claim 1, further comprising communicating the predictive typing entry as a text suggestion;
wherein the text suggestion may be a word, phrase, numerical quantity, price term, or combination thereof;
wherein the user may accept and reject the text suggestion for use; and
wherein the user may replace the text suggestion with a custom user input.
4. The method of claim 1, wherein the communication session includes a first time period and a second time period, and wherein the method further comprises:
receiving a first typed input from a user during the first period in a communication session;
gathering first context data corresponding to the first typed input and the first period in the communication session;
retrieving a first corresponding ontology, from the database of ontologies, based on the first context data;
providing the predictive typing entry based on the first typed input, the first context data and the first corresponding ontology;
receiving a second typed input from the user during the second time period in the communication session;
gathering second context data corresponding to the second typed input and the second period in the communication session;
retrieving a second corresponding ontology, from the database of ontologies, based on the second context data; and
providing the predictive typing entry based on the second typed input, the second context data and the second corresponding ontology.
5. The method of claim 1, further comprising the user saving the
corresponding ontology locally; and
recalling the corresponding ontology automatically.
6. The method of claim 1 , further comprising regularly creating a new
ontology, based on the context data and the user input;
storing the new ontology are stored in the database of ontologies; and
updating the new ontology with a subsequent related user input, wherein the subsequent related user input corresponds with the context data and the user input.
7. The method of claim 1 , wherein two or more ontology may be streamed to the user, wherein the two or more ontology includes a baseline ontology and a category specific ontology;
wherein the most frequently used keywords of the corresponding ontology are streamed to the user first;
wherein the two or more corresponding ontology are used to generate the predictive typing suggestion; and
wherein the predictive typing suggestion may be generated while the two or more corresponding ontology are only partially loaded,
8. The method of claim 1 , wherein the corresponding ontology may be comprised of two or more ontology components;
wherein the corresponding ontology and the two or more ontology components are dynamically loaded starting with a broadest ontology component, and providing additional narrower ontology components based on the context data and the input.
9. The method of claim 1, further comprising:
assigning a rank to the corresponding ontology based on a frequency of use, a conversion rate, a usage behavior, and an accuracy of the text suggestions;
wherein the frequency of use is the total number of times the corresponding ontology is used by the user, as compared with other ontologies in the database of ontologies;
wherein a higher conversion rate corresponds to a higher overall rank within the database of ontologies;
wherein the usage behavior is based on the keywords used from the corresponding ontology; and
wherein the accuracy of the predictive typing suggestion is calculated as the ratio of predictive typing suggestions rejected by the user against predictive typing suggestions accepted by the user; and
pre-caching the corresponding ontology with the highest assigned rank with the user.
10. The method of claim 2, further comprising pre-caching the corresponding ontology based on a previous context data associated with a previous communication session, the user transaction history, and the user query history.
11. A system to dynamically load contextual ontologies comprising:
a communications module, configured to receive an input from a user during a communication session;
a context data module, configured to gather context data corresponding to the received input from the user and the communication session;
an ontology database comprising ontologies;
an ontology module, configured to retrieve a corresponding ontology from the ontology database based on the context data;
a predictive typing entry module, configured to generate a predictive typing entry based on the context data, the received input, and the corresponding ontology, wherein the predictive typing entry generated by the predictive typing entry module is a text suggestion; and a presentation module, configured to present the predictive typing entry to the user.
12. The system of claim 11, wherein the corresponding ontology may
comprise two or more ontology components;
wherein the ontology module is further configured to dynamically retrieve the corresponding ontology and the two or more ontology components, starting with a broadest ontology component, and providing additional narrow ontology components based on the context data and the received input.
13. The system of claim 11, wherein the communications module is further configured to receive a user input to accept the text suggestion; and
receive a user input to reject the text suggestion.
14. The system of claim 11, wherein the ontology module is further
configured to assign a rank to the corresponding ontology;
wherein the rank is based on a frequency of use, a conversion rate, a usage behavior, and an accuracy of the text suggestions;
wherein the frequency of use is the total number of times the corresponding ontology is used by the user, as compared with other ontologies in the database of ontologies;
wherein a higher conversion rate corresponds to a higher overall rank within the database of ontologies;
wherein the usage behavior is based on the keywords used from the corresponding ontology; and
wherein the accuracy of the predictive typing suggestion is calculated as the ratio of predictive typing suggestions rejected by the user against predictive typing suggestions accepted by the user.
15. The system of claim 11, wherein the ontology module is further
configured to pre-cache the corresponding ontology.
16. A machine-readable storage medium storing instructions that, when
executed by a processor, causes the processor to perform a method to dynamically load contextual ontologies, the method comprising:
receiving an input from a user during a communication session; gathering context data corresponding to the input and the communication session;
retrieving a corresponding ontology from an ontology database based on the context data; and
generating a predictive typing entry based on the input, the context data and the corresponding ontology.
17. The machine-readable storage medium of claim 16, wherein the
corresponding ontology may comprise two or more ontology
components;
wherein the method to dynamically load contextual ontologies further comprises:
dynamically retrieving the corresponding ontology and the two or more ontology components, starting with a broadest ontology component, and providing additional narrow ontology components based on the context data and the input.
18. The machine-readable storage medium of claim 16, wherein the
predictive typing entry is a text suggestion which may be accepted or rejected by the user.
19. The machine-readable storage medium of claim 16, wherein the method to dynamically load contextual ontologies further comprises:
pre-caching the corresponding ontology.
20. The machine-readable storage medium of claim 16, wherein the method to dynamically load contextual ontologies further comprises:
assigning a rank to the corresponding ontology.
21. A machine readable medium carrying machine readable instructions that, when executed by a processor, causes the processor to carry out the method of any one of claims 1 to 10.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP15791181.9A EP3213231A1 (en) | 2014-10-30 | 2015-10-29 | Dynamically loading contextual ontologies for predictive typing |
| CN201580071686.6A CN107111612A (en) | 2014-10-30 | 2015-10-29 | Dynamic load is for the predictive context ontology keyed in |
| KR1020197028373A KR102159898B1 (en) | 2014-10-30 | 2015-10-29 | Dynamically loading contextual ontologies for predictive typing |
| KR1020177014616A KR20170078768A (en) | 2014-10-30 | 2015-10-29 | Dynamically loading contextual ontologies for predictive typing |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US14/528,857 | 2014-10-30 | ||
| US14/528,857 US9880714B2 (en) | 2014-10-30 | 2014-10-30 | Dynamic loading of contextual ontologies for predictive touch screen typing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2016069869A1 true WO2016069869A1 (en) | 2016-05-06 |
Family
ID=54477372
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2015/058001 Ceased WO2016069869A1 (en) | 2014-10-30 | 2015-10-29 | Dynamically loading contextual ontologies for predictive typing |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US9880714B2 (en) |
| EP (1) | EP3213231A1 (en) |
| KR (2) | KR102159898B1 (en) |
| CN (1) | CN107111612A (en) |
| WO (1) | WO2016069869A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9880714B2 (en) | 2014-10-30 | 2018-01-30 | Ebay Inc. | Dynamic loading of contextual ontologies for predictive touch screen typing |
Families Citing this family (132)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8677377B2 (en) | 2005-09-08 | 2014-03-18 | Apple Inc. | Method and apparatus for building an intelligent automated assistant |
| US9318108B2 (en) | 2010-01-18 | 2016-04-19 | Apple Inc. | Intelligent automated assistant |
| US8977255B2 (en) | 2007-04-03 | 2015-03-10 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
| US10002189B2 (en) | 2007-12-20 | 2018-06-19 | Apple Inc. | Method and apparatus for searching using an active ontology |
| US9330720B2 (en) | 2008-01-03 | 2016-05-03 | Apple Inc. | Methods and apparatus for altering audio output signals |
| US20100030549A1 (en) | 2008-07-31 | 2010-02-04 | Lee Michael M | Mobile device having human language translation capability with positional feedback |
| US8676904B2 (en) | 2008-10-02 | 2014-03-18 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
| US10706373B2 (en) | 2011-06-03 | 2020-07-07 | Apple Inc. | Performing actions associated with task items that represent tasks to perform |
| US10276170B2 (en) | 2010-01-18 | 2019-04-30 | Apple Inc. | Intelligent automated assistant |
| US8682667B2 (en) | 2010-02-25 | 2014-03-25 | Apple Inc. | User profiling for selecting user specific voice input processing information |
| US9262612B2 (en) | 2011-03-21 | 2016-02-16 | Apple Inc. | Device access using voice authentication |
| US10057736B2 (en) | 2011-06-03 | 2018-08-21 | Apple Inc. | Active transport based notifications |
| US10134385B2 (en) | 2012-03-02 | 2018-11-20 | Apple Inc. | Systems and methods for name pronunciation |
| US10417037B2 (en) | 2012-05-15 | 2019-09-17 | Apple Inc. | Systems and methods for integrating third party services with a digital assistant |
| KR20250004158A (en) | 2013-02-07 | 2025-01-07 | 애플 인크. | Voice trigger for a digital assistant |
| US10652394B2 (en) | 2013-03-14 | 2020-05-12 | Apple Inc. | System and method for processing voicemail |
| US10748529B1 (en) | 2013-03-15 | 2020-08-18 | Apple Inc. | Voice activated device for use with a voice-based digital assistant |
| WO2014197335A1 (en) | 2013-06-08 | 2014-12-11 | Apple Inc. | Interpreting and acting upon commands that involve sharing information with remote devices |
| US10176167B2 (en) | 2013-06-09 | 2019-01-08 | Apple Inc. | System and method for inferring user intent from speech inputs |
| HK1220268A1 (en) | 2013-06-09 | 2017-04-28 | 苹果公司 | Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant |
| US10791216B2 (en) | 2013-08-06 | 2020-09-29 | Apple Inc. | Auto-activating smart responses based on activities from remote devices |
| US10296160B2 (en) | 2013-12-06 | 2019-05-21 | Apple Inc. | Method for extracting salient dialog usage from live data |
| US9430463B2 (en) | 2014-05-30 | 2016-08-30 | Apple Inc. | Exemplar-based natural language processing |
| US9633004B2 (en) | 2014-05-30 | 2017-04-25 | Apple Inc. | Better resolution when referencing to concepts |
| US10579212B2 (en) | 2014-05-30 | 2020-03-03 | Apple Inc. | Structured suggestions |
| US10565219B2 (en) * | 2014-05-30 | 2020-02-18 | Apple Inc. | Techniques for automatically generating a suggested contact based on a received message |
| US10170123B2 (en) | 2014-05-30 | 2019-01-01 | Apple Inc. | Intelligent assistant for home automation |
| US9715875B2 (en) | 2014-05-30 | 2017-07-25 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
| US9966065B2 (en) | 2014-05-30 | 2018-05-08 | Apple Inc. | Multi-command single utterance input method |
| US9338493B2 (en) | 2014-06-30 | 2016-05-10 | Apple Inc. | Intelligent automated assistant for TV user interactions |
| US9818400B2 (en) | 2014-09-11 | 2017-11-14 | Apple Inc. | Method and apparatus for discovering trending terms in speech requests |
| US10127911B2 (en) | 2014-09-30 | 2018-11-13 | Apple Inc. | Speaker identification and unsupervised speaker adaptation techniques |
| US9668121B2 (en) | 2014-09-30 | 2017-05-30 | Apple Inc. | Social reminders |
| US10074360B2 (en) | 2014-09-30 | 2018-09-11 | Apple Inc. | Providing an indication of the suitability of speech recognition |
| US10152299B2 (en) | 2015-03-06 | 2018-12-11 | Apple Inc. | Reducing response latency of intelligent automated assistants |
| US9886953B2 (en) | 2015-03-08 | 2018-02-06 | Apple Inc. | Virtual assistant activation |
| US9721566B2 (en) | 2015-03-08 | 2017-08-01 | Apple Inc. | Competing devices responding to voice triggers |
| US10460227B2 (en) | 2015-05-15 | 2019-10-29 | Apple Inc. | Virtual assistant in a communication session |
| US10083688B2 (en) | 2015-05-27 | 2018-09-25 | Apple Inc. | Device voice control for selecting a displayed affordance |
| US10200824B2 (en) | 2015-05-27 | 2019-02-05 | Apple Inc. | Systems and methods for proactively identifying and surfacing relevant content on a touch-sensitive device |
| US9578173B2 (en) | 2015-06-05 | 2017-02-21 | Apple Inc. | Virtual assistant aided communication with 3rd party service in a communication session |
| US11025565B2 (en) | 2015-06-07 | 2021-06-01 | Apple Inc. | Personalized prediction of responses for instant messaging |
| US20160378747A1 (en) | 2015-06-29 | 2016-12-29 | Apple Inc. | Virtual assistant for media playback |
| US10762517B2 (en) * | 2015-07-01 | 2020-09-01 | Ebay Inc. | Subscription churn prediction |
| US10671428B2 (en) | 2015-09-08 | 2020-06-02 | Apple Inc. | Distributed personal assistant |
| US10331312B2 (en) | 2015-09-08 | 2019-06-25 | Apple Inc. | Intelligent automated assistant in a media environment |
| US10740384B2 (en) | 2015-09-08 | 2020-08-11 | Apple Inc. | Intelligent automated assistant for media search and playback |
| US10747498B2 (en) | 2015-09-08 | 2020-08-18 | Apple Inc. | Zero latency digital assistant |
| US10445425B2 (en) | 2015-09-15 | 2019-10-15 | Apple Inc. | Emoji and canned responses |
| US10366158B2 (en) * | 2015-09-29 | 2019-07-30 | Apple Inc. | Efficient word encoding for recurrent neural network language models |
| US11587559B2 (en) | 2015-09-30 | 2023-02-21 | Apple Inc. | Intelligent device identification |
| US10691473B2 (en) | 2015-11-06 | 2020-06-23 | Apple Inc. | Intelligent automated assistant in a messaging environment |
| US10956666B2 (en) | 2015-11-09 | 2021-03-23 | Apple Inc. | Unconventional virtual assistant interactions |
| US10049668B2 (en) | 2015-12-02 | 2018-08-14 | Apple Inc. | Applying neural network language models to weighted finite state transducers for automatic speech recognition |
| US10223066B2 (en) | 2015-12-23 | 2019-03-05 | Apple Inc. | Proactive assistance based on dialog communication between devices |
| US20170193579A1 (en) * | 2015-12-31 | 2017-07-06 | Ebay Inc. | System and method to calculate session-based price demand on e-commerce site |
| US11227589B2 (en) | 2016-06-06 | 2022-01-18 | Apple Inc. | Intelligent list reading |
| US10049663B2 (en) | 2016-06-08 | 2018-08-14 | Apple, Inc. | Intelligent automated assistant for media exploration |
| US12223282B2 (en) | 2016-06-09 | 2025-02-11 | Apple Inc. | Intelligent automated assistant in a home environment |
| US10586535B2 (en) | 2016-06-10 | 2020-03-10 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
| US12197817B2 (en) | 2016-06-11 | 2025-01-14 | Apple Inc. | Intelligent device arbitration and control |
| DK179415B1 (en) | 2016-06-11 | 2018-06-14 | Apple Inc | Intelligent device arbitration and control |
| DK201670540A1 (en) | 2016-06-11 | 2018-01-08 | Apple Inc | Application integration with a digital assistant |
| US10474753B2 (en) | 2016-09-07 | 2019-11-12 | Apple Inc. | Language identification using recurrent neural networks |
| US10043516B2 (en) | 2016-09-23 | 2018-08-07 | Apple Inc. | Intelligent automated assistant |
| US20180089309A1 (en) * | 2016-09-28 | 2018-03-29 | Linkedln Corporation | Term set expansion using textual segments |
| US20180101599A1 (en) * | 2016-10-08 | 2018-04-12 | Microsoft Technology Licensing, Llc | Interactive context-based text completions |
| US11281993B2 (en) | 2016-12-05 | 2022-03-22 | Apple Inc. | Model and ensemble compression for metric learning |
| US11204787B2 (en) | 2017-01-09 | 2021-12-21 | Apple Inc. | Application integration with a digital assistant |
| DK201770383A1 (en) | 2017-05-09 | 2018-12-14 | Apple Inc. | User interface for correcting recognition errors |
| US10417266B2 (en) | 2017-05-09 | 2019-09-17 | Apple Inc. | Context-aware ranking of intelligent response suggestions |
| US10726832B2 (en) | 2017-05-11 | 2020-07-28 | Apple Inc. | Maintaining privacy of personal information |
| US10395654B2 (en) | 2017-05-11 | 2019-08-27 | Apple Inc. | Text normalization based on a data-driven learning network |
| DK180048B1 (en) | 2017-05-11 | 2020-02-04 | Apple Inc. | MAINTAINING THE DATA PROTECTION OF PERSONAL INFORMATION |
| DK201770428A1 (en) | 2017-05-12 | 2019-02-18 | Apple Inc. | Low-latency intelligent automated assistant |
| US11301477B2 (en) | 2017-05-12 | 2022-04-12 | Apple Inc. | Feedback analysis of a digital assistant |
| DK179496B1 (en) | 2017-05-12 | 2019-01-15 | Apple Inc. | USER-SPECIFIC Acoustic Models |
| DK179745B1 (en) | 2017-05-12 | 2019-05-01 | Apple Inc. | SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT |
| DK201770411A1 (en) | 2017-05-15 | 2018-12-20 | Apple Inc. | MULTI-MODAL INTERFACES |
| US10303715B2 (en) | 2017-05-16 | 2019-05-28 | Apple Inc. | Intelligent automated assistant for media exploration |
| US10403278B2 (en) | 2017-05-16 | 2019-09-03 | Apple Inc. | Methods and systems for phonetic matching in digital assistant services |
| US20180336892A1 (en) | 2017-05-16 | 2018-11-22 | Apple Inc. | Detecting a trigger of a digital assistant |
| US10311144B2 (en) | 2017-05-16 | 2019-06-04 | Apple Inc. | Emoji word sense disambiguation |
| DK179549B1 (en) | 2017-05-16 | 2019-02-12 | Apple Inc. | Far-field extension for digital assistant services |
| US10657328B2 (en) | 2017-06-02 | 2020-05-19 | Apple Inc. | Multi-task recurrent neural network architecture for efficient morphology handling in neural language modeling |
| US10445429B2 (en) | 2017-09-21 | 2019-10-15 | Apple Inc. | Natural language understanding using vocabularies with compressed serialized tries |
| US10755051B2 (en) | 2017-09-29 | 2020-08-25 | Apple Inc. | Rule-based natural language processing |
| US10636424B2 (en) | 2017-11-30 | 2020-04-28 | Apple Inc. | Multi-turn canned dialog |
| WO2019126326A1 (en) * | 2017-12-19 | 2019-06-27 | Fractal Industries, Inc. | System and method for automatic creation of ontological databases and semantic searching |
| US10733982B2 (en) | 2018-01-08 | 2020-08-04 | Apple Inc. | Multi-directional dialog |
| US10733375B2 (en) | 2018-01-31 | 2020-08-04 | Apple Inc. | Knowledge-based framework for improving natural language understanding |
| US10789959B2 (en) | 2018-03-02 | 2020-09-29 | Apple Inc. | Training speaker recognition models for digital assistants |
| US10592604B2 (en) | 2018-03-12 | 2020-03-17 | Apple Inc. | Inverse text normalization for automatic speech recognition |
| US10818288B2 (en) | 2018-03-26 | 2020-10-27 | Apple Inc. | Natural assistant interaction |
| US10909331B2 (en) | 2018-03-30 | 2021-02-02 | Apple Inc. | Implicit identification of translation payload with neural machine translation |
| US11145294B2 (en) | 2018-05-07 | 2021-10-12 | Apple Inc. | Intelligent automated assistant for delivering content from user experiences |
| US10928918B2 (en) | 2018-05-07 | 2021-02-23 | Apple Inc. | Raise to speak |
| US10984780B2 (en) | 2018-05-21 | 2021-04-20 | Apple Inc. | Global semantic word embeddings using bi-directional recurrent neural networks |
| CN108733814B (en) * | 2018-05-21 | 2021-07-23 | Oppo广东移动通信有限公司 | Search engine preloading method, device, storage medium and terminal |
| DK201870355A1 (en) | 2018-06-01 | 2019-12-16 | Apple Inc. | Virtual assistant operation in multi-device environments |
| DK180639B1 (en) | 2018-06-01 | 2021-11-04 | Apple Inc | DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT |
| US10892996B2 (en) | 2018-06-01 | 2021-01-12 | Apple Inc. | Variable latency device coordination |
| US11386266B2 (en) | 2018-06-01 | 2022-07-12 | Apple Inc. | Text correction |
| DK179822B1 (en) | 2018-06-01 | 2019-07-12 | Apple Inc. | Voice interaction at a primary device to access call functionality of a companion device |
| US10944859B2 (en) | 2018-06-03 | 2021-03-09 | Apple Inc. | Accelerated task performance |
| US11010561B2 (en) | 2018-09-27 | 2021-05-18 | Apple Inc. | Sentiment prediction from textual data |
| US11462215B2 (en) | 2018-09-28 | 2022-10-04 | Apple Inc. | Multi-modal inputs for voice commands |
| US11170166B2 (en) | 2018-09-28 | 2021-11-09 | Apple Inc. | Neural typographical error modeling via generative adversarial networks |
| US10839159B2 (en) | 2018-09-28 | 2020-11-17 | Apple Inc. | Named entity normalization in a spoken dialog system |
| US11475898B2 (en) | 2018-10-26 | 2022-10-18 | Apple Inc. | Low-latency multi-speaker speech recognition |
| US11638059B2 (en) | 2019-01-04 | 2023-04-25 | Apple Inc. | Content playback on multiple devices |
| US11348573B2 (en) | 2019-03-18 | 2022-05-31 | Apple Inc. | Multimodality in digital assistant systems |
| CN110008331B (en) * | 2019-04-15 | 2021-09-14 | 腾讯科技(深圳)有限公司 | Information display method and device, electronic equipment and computer readable storage medium |
| US11423908B2 (en) | 2019-05-06 | 2022-08-23 | Apple Inc. | Interpreting spoken requests |
| US11475884B2 (en) | 2019-05-06 | 2022-10-18 | Apple Inc. | Reducing digital assistant latency when a language is incorrectly determined |
| DK201970509A1 (en) | 2019-05-06 | 2021-01-15 | Apple Inc | Spoken notifications |
| US11307752B2 (en) | 2019-05-06 | 2022-04-19 | Apple Inc. | User configurable task triggers |
| US11140099B2 (en) | 2019-05-21 | 2021-10-05 | Apple Inc. | Providing message response suggestions |
| US11289073B2 (en) | 2019-05-31 | 2022-03-29 | Apple Inc. | Device text to speech |
| DK201970510A1 (en) | 2019-05-31 | 2021-02-11 | Apple Inc | Voice identification in digital assistant systems |
| US11496600B2 (en) | 2019-05-31 | 2022-11-08 | Apple Inc. | Remote execution of machine-learned models |
| DK180129B1 (en) | 2019-05-31 | 2020-06-02 | Apple Inc. | USER ACTIVITY SHORTCUT SUGGESTIONS |
| US11468890B2 (en) | 2019-06-01 | 2022-10-11 | Apple Inc. | Methods and user interfaces for voice-based control of electronic devices |
| US11360641B2 (en) | 2019-06-01 | 2022-06-14 | Apple Inc. | Increasing the relevance of new available information |
| US11488406B2 (en) | 2019-09-25 | 2022-11-01 | Apple Inc. | Text detection using global geometry estimators |
| US11061543B1 (en) | 2020-05-11 | 2021-07-13 | Apple Inc. | Providing relevant data items based on context |
| US11183193B1 (en) | 2020-05-11 | 2021-11-23 | Apple Inc. | Digital assistant hardware abstraction |
| US12301635B2 (en) | 2020-05-11 | 2025-05-13 | Apple Inc. | Digital assistant hardware abstraction |
| US11490204B2 (en) | 2020-07-20 | 2022-11-01 | Apple Inc. | Multi-device audio adjustment coordination |
| US11438683B2 (en) | 2020-07-21 | 2022-09-06 | Apple Inc. | User identification using headphones |
| US20240169148A1 (en) * | 2022-09-28 | 2024-05-23 | Grammarly, Inc. | Privacy-controlled generation of suggested snippets |
| US12436978B2 (en) * | 2023-01-06 | 2025-10-07 | Yoshinori Kobayashi | Information processing system and information processing program |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009090262A2 (en) * | 2008-01-18 | 2009-07-23 | Ugochukwu Akuwudike | Method and system for storing and retrieving characters, words and phrases |
| WO2009146528A1 (en) * | 2008-06-03 | 2009-12-10 | Just Parts Online Inc . | System and method for listing items online |
| US20100049766A1 (en) * | 2006-08-31 | 2010-02-25 | Peter Sweeney | System, Method, and Computer Program for a Consumer Defined Information Architecture |
| US20120023120A1 (en) * | 2010-07-22 | 2012-01-26 | Google Inc. | Predictive query suggestion caching |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006108069A2 (en) * | 2005-04-06 | 2006-10-12 | Google, Inc. | Searching through content which is accessible through web-based forms |
| US9318108B2 (en) * | 2010-01-18 | 2016-04-19 | Apple Inc. | Intelligent automated assistant |
| US20080294622A1 (en) * | 2007-05-25 | 2008-11-27 | Issar Amit Kanigsberg | Ontology based recommendation systems and methods |
| US7734641B2 (en) * | 2007-05-25 | 2010-06-08 | Peerset, Inc. | Recommendation systems and methods using interest correlation |
| US8983989B2 (en) * | 2010-02-05 | 2015-03-17 | Microsoft Technology Licensing, Llc | Contextual queries |
| US20110219299A1 (en) * | 2010-03-07 | 2011-09-08 | DSNR Labs Ltd. | Method and system of providing completion suggestion to a partial linguistic element |
| US9037459B2 (en) * | 2011-03-14 | 2015-05-19 | Apple Inc. | Selection of text prediction results by an accessory |
| US9529522B1 (en) * | 2012-09-07 | 2016-12-27 | Mindmeld, Inc. | Gesture-based search interface |
| US9244905B2 (en) * | 2012-12-06 | 2016-01-26 | Microsoft Technology Licensing, Llc | Communication context based predictive-text suggestion |
| US9477752B1 (en) * | 2013-09-30 | 2016-10-25 | Verint Systems Inc. | Ontology administration and application to enhance communication data analytics |
| US9589050B2 (en) * | 2014-04-07 | 2017-03-07 | International Business Machines Corporation | Semantic context based keyword search techniques |
| US9880714B2 (en) | 2014-10-30 | 2018-01-30 | Ebay Inc. | Dynamic loading of contextual ontologies for predictive touch screen typing |
-
2014
- 2014-10-30 US US14/528,857 patent/US9880714B2/en not_active Expired - Fee Related
-
2015
- 2015-10-29 EP EP15791181.9A patent/EP3213231A1/en not_active Withdrawn
- 2015-10-29 KR KR1020197028373A patent/KR102159898B1/en not_active Expired - Fee Related
- 2015-10-29 CN CN201580071686.6A patent/CN107111612A/en active Pending
- 2015-10-29 WO PCT/US2015/058001 patent/WO2016069869A1/en not_active Ceased
- 2015-10-29 KR KR1020177014616A patent/KR20170078768A/en not_active Ceased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100049766A1 (en) * | 2006-08-31 | 2010-02-25 | Peter Sweeney | System, Method, and Computer Program for a Consumer Defined Information Architecture |
| WO2009090262A2 (en) * | 2008-01-18 | 2009-07-23 | Ugochukwu Akuwudike | Method and system for storing and retrieving characters, words and phrases |
| WO2009146528A1 (en) * | 2008-06-03 | 2009-12-10 | Just Parts Online Inc . | System and method for listing items online |
| US20120023120A1 (en) * | 2010-07-22 | 2012-01-26 | Google Inc. | Predictive query suggestion caching |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9880714B2 (en) | 2014-10-30 | 2018-01-30 | Ebay Inc. | Dynamic loading of contextual ontologies for predictive touch screen typing |
Also Published As
| Publication number | Publication date |
|---|---|
| KR20190114016A (en) | 2019-10-08 |
| EP3213231A1 (en) | 2017-09-06 |
| CN107111612A (en) | 2017-08-29 |
| US9880714B2 (en) | 2018-01-30 |
| KR20170078768A (en) | 2017-07-07 |
| KR102159898B1 (en) | 2020-09-24 |
| US20160125071A1 (en) | 2016-05-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9880714B2 (en) | Dynamic loading of contextual ontologies for predictive touch screen typing | |
| JP6916351B2 (en) | Saving the state of the communication session | |
| US12192256B2 (en) | Personalized content sharing platform | |
| US11455348B2 (en) | Systems and methods for saving and presenting a state of a communication session | |
| US20150120386A1 (en) | System and method for identifying purchase intent |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15791181 Country of ref document: EP Kind code of ref document: A1 |
|
| REEP | Request for entry into the european phase |
Ref document number: 2015791181 Country of ref document: EP |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 20177014616 Country of ref document: KR Kind code of ref document: A |