CN102460417B - Domain state, role and kind - Google Patents

Abstract

Systems and methods for creating and using a domain specification including identifying a state of a first page associated with a domain. The first page is found and additional pages from the domain are identified based on hyperlinks from the first page. The status of the additional pages is identified and the hyperlinks are prioritized based on the status and/or a comparison with predetermined data. Content is extracted from the first page and pages selected between the additional pages. The designated additional pages may be selected based on the priority order. The found content may be processed through a signature marker set to determine a contextual match. The purpose of the domain is determined based on the first page status, the additional page statuses, and the result of the content processing. The domain specification can be displayed, stored, transmitted, and/or searched to identify websites or attributes of interest.

Description

Domain state, role and kind

Background technique

As the number of active web sites on the Internet grows, there are increasing demands for organizing and evaluating available content. Search engines make it easier for individual users to discover and access available information. A typical search engine may include algorithms that help identify relevant content based on a user's search terms. These may include, for example, in view of the apparent generality, based on the transaction of the website, pertaining to a specific page with the requested content. However, there are limitations in the performance of common services that typically download content from a website, index it, and then allow users to search based on the downloaded content.

An understanding of the way in which the Internet is inherently organized can help in understanding the requirements associated with effectively using the entire range of information accessible through the Internet. The Domain Name System (DNS) is part of the Internet infrastructure that translates human-readable domain names into the Internet Protocol (IP) numbers needed to establish TCP/IP communications over the Internet. That is, DNS allows users to refer to websites and other resources more easily using to remember domain names, such as "www.example.com", rather than the numerical IP addresses, such as "123.4.56.78", assigned to computer. Each domain name consists of a series of character strings (symbols) separated by dots. The rightmost symbol in a domain name is known as the "top-level domain name" (TLD). Examples of well known TLDs are ".com", ".net", ".org", etc. Each TLD supports second-level domains, listed immediately to the left of the TLD, such as the "example" level in "www.example.com". Each second level domain may include multiple third level domains immediately to the left of the second level domain, such as the "www" level in "www.example.com". Additional levels of domains can also exist, virtually unlimited. For example, a domain with an additional domain level could be "www.photos.example.com".

It should also be noted that a single IP address, such as a single server, can support multiple domain names. That is, different domain names may resolve to the same server, which can then determine what content to serve based on the requested domain name and/or additional non-domain information. This is sometimes called virtual hosting.

Additional non-domain information may be included in the Uniform Resource Identifier ("URI") structure that includes the domain name. For example, a "path" part is a series of segments (conceptually similar to directories, although they don't have to be represented), separated by slashes ("/"). This information can be included immediately to the right of the domain name, as in "blog" in "www.example.com/blog", and can be used by a server or other receiving device to identify and deliver specific content or run specific code. Other examples of non-domain information may include queries and fragments, the details of which are understood by those of ordinary skill in the art and will not be discussed in detail here. This combination of information may be included in a web page hyperlink that directs the user to another portion of the same page or to another web page that may be part of the same or a different domain.

Related domain names and content can be organized in a hierarchical or nested fashion, such as "www.example.com"; "www.blog.example.com"; "www.example.com/blog"; or "blog.example.com ” and so on, each with a different meaning. Such related domains do not need to share the same part of the actual IP address to the respective domain name resolution locations. In this regard, parts of the domain name may represent the specific server required, for example, "mail.example.com" and "www.example.com" may resolve to different servers with different functions for the same two domain.

Responsibility for operating each TLD (including maintaining a registry of second-level domains within that TLD) is delegated to specific organizations, known as domain name registries ("registries"). The registry is primarily responsible for translating domain names into IP addresses (“resolving”) and operating its top-level domains through DNS servers that maintain such information in large databases.

Contents of the invention

The subject matter can provide advantages in the accessibility and meaningful improvement of domain-related content. By considering domain characteristics that have not been identified in a systematic manner, users can search on domain attributes and, in a broader application, use information publicly available through DNS servers and websites to construct descriptions related to domain websites. As used herein, domain characteristics may include, but are not limited to, the data content of a part of a web page, the data content of a linked web page, the data content of a part of the DNS resolution support system of the web page, and the like. Thus, given a domain name, relevant information such as attributes and characteristics of the website can be provided based on an extended search against the domain name. The related information may also provide improved search results based on attributes describing the domain and/or the content of the domain. According to these descriptions, improved analysis of subsets of content available on the Internet can be processed, which can also be used generally to improve the efficiency and productivity of individual users, business activities and web content support services.

Embodiments of the invention relate to systems and methods for analyzing domains. Embodiments may include identifying the state of the first page associated with the domain. Identifying the status may include attempting to resolve the domain name of the first page and, if the domain name resolution fails, identifying the status of the domain as inoperable, and identifying the status as inaccessible if the domain name resolves but the content is inaccessible .

If the first page is accessible, then the content of the first page can be extracted. The domain can then identify additional pages based on the hyperlinks from the first page. The status of these additional pages can then be identified as the status of the first page. That is, identifying the status of the additional pages may include attempting to resolve the domain name or network address of the first additional page, and if the domain name or network address resolution fails, identifying the status of the first additional page as inoperable. If the domain name is resolved, but the content is inaccessible, the status of the first additional page can be identified as inaccessible, and so on for other web pages.

Additionally, the hyperlinks may be prioritized based on the status and/or comparison to a predetermined date. For example, character strings within a URI may be predetermined to have high or low importance. Thus, the preferred order of hyperlinks containing such strings can be distinguished accordingly. Content may be extracted from the first page and selected ones of the plurality of additional pages. Content may include the entire range of domain features discussed herein. Selection of specific pages among these additional pages can be made based on their order of preference.

The content of the first page and the additional pages may be processed by pre-determining or generating a set of data to determine a contextual match between the content. This predetermined or generated data will be referred to as a signature token set. Think of a signature tag set as a table of data relating known components to some other objects. For example, a known term can be correlated with how often that term occurs on a sample of domain names. A comparison of a word found on a page with the domain frequency of that word may be the first step in the word processing through the signature tag set. In an embodiment, this can help determine the domain specification more precisely by focusing on words with low domain frequency, which may be more discriminative than words with high domain frequency. The set of signature tokens may also use techniques to reduce potential word ambiguities. For example, the content may be compared to predetermined data representing a known relationship of multiple data content. This can include known textual relationships, known data type relationships and various combinations of similar data included in domain features. Thus, the importance of the first object is determined more precisely by the identification of the second relevant object in the domain feature. As indicated above, domain characteristics can include data from or linked to the web page itself, or DNS information such as the IP address or URL.

Based on the context match, the status of the first page and the status of the additional page, the purpose of the domain can be determined. Embodiments may include where the content includes executable code embedded in the first page or the additional pages, and configuring the set of signature tags to determine contextual matches within the executable code. Embodiments may also include where the content includes image, video, and audio information embedded in the first page or the additional pages, and configuring the set of signature tags to determine contextual matches within the image, video, and audio information .

Once determined, the purpose of the field may be used in a number of different ways, including searching for, displaying, storing and/or transmitting the determined purpose of the field. Embodiments may include identifying and obtaining related domains based on the domain's determined status and purpose.

Embodiments may include determining the purpose of the domain based on at least one of the determined domain name, registrar reseller indicia, absence of specified data types, alternate publishers of the pages, social group identification, and data types in the content.

Embodiments may also include identifying one or more domains, based on their purpose. The category of the recognition field can then be determined, which is distinct from the respective purpose of the field. Related domains can then be identified and obtained based on the domain's predetermined purpose and category.

An embodiment may include following a hyperlink from the first page by passing a redirect to the http version of the page.

Embodiments may also include receiving a set of input fields from a user; identifying attributes that are common in the input fields from between the contextually matched content; and outputting the identified attributes to the user.

Embodiments may include receiving an input set of purposes and/or categories from a user; identifying domains corresponding to the input set of purposes and/or categories; and outputting the identified domains to the user.

Embodiments may include structures for performing the described method and compiling the historical analysis of the relevant domain space in an alternate manner on a domain-wide basis.

Embodiments of the invention can also include a system implementing the described method, together with a computer-readable storage medium encoded with instructions causing a computer to perform the described method. For example, an electronic system including a processor, memory, and electronic communication device may be configured to identify the state of a first page associated with a domain, and obtain the first page, through the electronic communication device; based on a hyperlink from the first from the identifying a plurality of additional pages at the domain; identifying the status of the additional pages by the electronic communication device; prioritizing the hyperlinks based on a comparison with predetermined data; at least one page from the first page and the plurality of additional pages Extracting content at, by the electronic communication device, at least one of the plurality of additional pages selected based on the priority order; processing the content through a set of signature tags to determine a contextual match; determining the purpose of the field, according to the first page status of these additional pages and the processing results of the content; and at least one of displaying, storing and transmitting for the determined purpose of the domain.

Further advantages of the inventive subject matter will become apparent to those of ordinary skill in the art upon reading and understanding the following detailed description of the preferred embodiment.

Description of drawings

Figure 1 depicts an exemplary system according to an embodiment of the present invention;

Figure 2 depicts an exemplary method according to an embodiment of the invention;

Figure 3 depicts an exemplary web page and associated content according to an embodiment of the present invention;

Figure 4 graphically depicts exemplary hierarchical data parsing in accordance with an embodiment of the present invention;

Figure 5 graphically depicts an exemplary process flow in accordance with an embodiment of the present invention; and

Figure 6 depicts aspects of an exemplary method in accordance with an embodiment of the invention.

Detailed ways

Embodiments of the present invention can help users, web content providers, and/or registries understand how to determine the purpose of a domain name. A holistic view of the online activity of an industry segment can be constructed to provide an understanding of the online environment and to complement other micro-analysis tools. Thus, the systems and methods described herein can generate results that can provide data for domain site purposes.

Given a domain name, the described systems and methods can be derived from attributes/characteristics associated with sites accessible through that domain name. The service can also allow users to search domains based on criteria that may include a number of attributes describing the domain or content on the domain. Embodiments can use information contained in publicly available DNS servers and content available in publicly available websites to construct descriptions associated with domain websites.

Embodiments can collect and provide different types of data related to domains in a hierarchical manner, such as described in FIG. 1 . Embodiments are able to determine domain status, by attempting to load a web page, by determining the domain's purpose and domain category, by capturing textual or other data from a website and passing it through a set of signature tags.

The systems and methods attempt to collect information related to the following exemplary attributes of a reference domain website: domain status; domain purpose; domain category; domain transactions, domain keywords, domain features/features/functions, and domain content. These properties are described further below. Through the data collection and analysis described, embodiments of the present invention can also provide an improved directory of TLDs, such as the .com and .net TLDs, and an overview of their usage for website hosts. For example, by determining domain descriptions for all domains or a subset of domains within a TLD, an improved directory can be created that classifies the relevant domains according to patterns of presence within the domain space, rather than according to the categories identified and used by individual web page content . This may provide previously unrecognized advantages in the management of Internet structures and services at various levels. For example, by identifying the status, purpose, and category of domains, rather than individual individual web pages, individual users, content providers, and registries can better understand content associations and identify patterns directly related to the marks and uses of this Internet other important aspects.

The following exemplary method is described with reference to FIGS. 2 and 3 . As described in FIG. 2, the method may start at step S1000, wherein the status of the first page is determined. The state of the domain involves whether and resolving the domain. For example, it can be determined whether there is a web server associated with the domain and, if so, whether the web server can be accessed. Further information may include whether there are any specifically identified web server errors. For example, a domain name is entered and passed to a DNS server in an attempt to resolve the domain name. If the domain name resolution fails, the status of the domain may be determined as non-operational. If the domain name is resolved, but the content is inaccessible, the status can be identified as inaccessible. Other state identifications are also possible.

The status of a domain may indicate the operational status of the associated website, such as activity, HTTP errors, and the like. The status of the domain may indicate whether the website is accessible from the particular domain, and if not, at what stage attempts to access the website failed. Access failures may include error codes assigned to the domain website, such as those indicated in Table 1.

Table 1:

If one or more of the domain query results is a non-running or otherwise inaccessible error, the method proceeds to step S1010 to step S1700, wherein the purpose of the domain is determined based on the determined status. For example, a status code, such as a name server error, can be used to determine a general inability to function, or a more specific inability to function in relation to an error code.

If the domain name resolves, but results in a redirect, it may be included in the determination of the domain status. For example, domains whose status may be determined to be "redirected" do not have active content.

If the domain name's web server is successfully connected to and fails to result in being redirected, the content of the first page 500, as an example indicated in FIG. 3, can then be obtained in step S1100.

In step S1100, the content from the first page is obtained, such as elements 502, 504, 506 and 508. This content can be in various forms known to those skilled in the art, including, for example, text, multimedia, hyperlinks, or other executable code. By way of example, elements 502, 504, and 506 may be webpage buttons that activate hyperlinks to webpages 510, 520, and 530, respectively. Element 508 may be text, graphics, or other multimedia data content. This content can be used for at least two purposes described herein. One purpose may be to identify any other pages related to the first page, for example, accessible through the first page, based on hyperlinks embedded in the first page, such as elements 502, 504, 506. This function may be performed in step S1200. That is, a plurality of additional pages, such as 510, 520, 530, can be identified based on hyperlinks detected in the first page. It should be noted that although exemplary pages 510, 520, and 530 share the same second-level domain, other pages related to, eg, hyperlinked from page 500 do not necessarily need to share the same domain. Another purpose of this content may be to help determine the purpose of this domain, which is discussed further below. The method continues to step S1300.

In step S1300, the status of the additional pages such as 510, 520 and 530 can be identified. Identifying the status of the additional page may include attempting to resolve the domain name or network address of the first additional page, and if resolution of the domain name or network address fails, identifying the status of the first additional page as inoperable. If the domain name resolves but the content is inaccessible, the status of the first additional page may be identified as operational but inaccessible. Other status identifications are also possible, as described above with reference to the status determination of the first page 500 . The method continues to step S1400.

In step S1400, the identified hyperlinks and associated additional web pages may be prioritized based on comparison with predetermined data. For example, hyperlink data, including domain, and non-domain URI information, can be compared to predetermined tokens, such as lists of important keywords, characters, or other values, that suggest desired content. Structural analysis of the hyperlink data may also be used as part of the process to identify patterns of information, such as specific nesting formats and the like. As a result, a prioritized list of the identified hyperlinks may be generated.

The user can choose which specific flags to use to customize this priority. It may include presenting to the user a list of already recognized indicia in the identifying hyperlink data and allowing the user to select among these indicia. To further assist the user, the user may be provided with optional additional information related to the recognized marker. For example, each of the recognized tokens may be given a quantitative or qualitative value, which helps the user estimate which token is most important to the user or the domain in question. For example, the user may have a particular interest in certain identifying tags, or a group of tags may appear more relevant based on the quantitative value of the tag's occurrence in the hyperlink data. Thus, the user can select from among the particular indicia presented to the user based on additional predetermined information related to these indicia. This can provide a facility for identifying more relevant web pages from which to extract content from a portion of the domain description. The method continues to step S1500.

In step S1500, additional content, such as content 508, may be extracted from the first page 500, and if necessary, content may be extracted from a selected page of the plurality of additional pages. Selection of designated pages from these additional pages may be based on their priority order. For example, if additional pages 510, 520, and 530 are prioritized such that page 530 has the lowest priority, content may only be aggregated from pages 510 and 520. In an embodiment, page 530 can be designated as low priority based on the text string "mail" within the domain name. This saves resources and also leads to more precise results at a later step by identifying the most relevant additional pages and content. The type of content aggregated may also be determined based on the parameters of the set of signature tags discussed further below. For example, text content may be all required data if the signature tag set is configured as text only. This distinction can also provide efficiencies in the large proportions of data that are aggregated and analyzed. This can improve the overall accuracy of the analysis if the signature tag set is configured to handle multiple data types.

Transmitting redirects may also be included based on the hyperlink data from the first page. For example, hyperlink data may not resolve directly to another web page, but instead may need to indicate a redirection. Thus, the "additional page" may be indirectly linked or related to the first page. This may also include sending a redirect to the http version of the page. The method continues to step S1600.

In step S1600, the content collected from the first page and the additional pages may be processed through a set of signature tags to determine a contextual match between the content. As noted above, the set of signature tags may include linked data elements providing a contextual match, or the importance of one of the data elements. By identifying contextual matches of aggregated content, appropriate weights can be given importance to various portions of the content. For example, when the term "Ford" is an automobile manufacturer, it is also a common surname and, by itself, of uncertain importance. This can lead to incorrect consideration or disregard of the term as part of the web page content. Disambiguation of terms may require usage of "Ford" and other recognized car terms to more closely approximate the term "Ford" to be considered relevant to the class of cars. The N-gram model is a type of probabilistic model that redirects the next item in the sequence. N-grams are used in various areas of statistical natural speech processing and general sequence analysis, and can be used in the current topic to refine the content processing described here. For example, the n-gram model redirects xi based on xi _{-1 , xi-2} ,…, x _in . With reference to the tags used to prioritize the hyperlink data and additional pages as described above, the method may allow the user to select a desired link from among identified links. For example, the user may identify certain identified context matches as valid and others as invalid, or to be ignored. In addition, these methods can help the user identify the importance of a contextual match by providing additional quantitative or qualitative information in conjunction with the contextual match. Thus, automated methods can be used to evaluate the weighting given to the contextual match, as in the case of a predetermined set of signature signatures automatically used to extract content, or the user can be assisted in doing so, as in allowing the user to receive , as in the case of weighted or rejected matches before and after recognition.

With reference to the set of signature tags, the particular type of data processed from the content is not limited to text or other descriptive data. For example, embodiments may include, where the content includes executable code embedded in the first page or the additional pages, configuring the set of signature tags to determine context within the executable code or within the results of the executable code match. Embodiments may also include, where the content includes image, video and/or audio information embedded in the first page or the additional pages, configuring the set of signature tags to determine before and after matching. For example, there may be contextual matches between various audio data such as pattern recognition results, audio type, length, or any number of related attributes. A mass of audio information of the same pattern may be a strong indicator of a particular type of web page, such as content directed to a particular musical artist, and thus of particular importance.

Where both the hyperlink tag and the set of signature tags are present, a tag performance report may be included to provide improved performance. For example, a user may be presented with a qualitative assessment of the performance of a personal marker. Alternatively, or in conjunction with the automated assessment, the user can independently assess and rate the efficacy of the marker. Thus, the system can ensure that the marker used is valid, by providing reports on the marker's performance, and allowing for variations in the marker's usage. This report can be presented to a user who can implement changes, or the system can automatically discard poor performing markers, such as those falling below certain thresholds. After processing the content, the method continues to step S1700.

In step S1700, the purpose of the field may be determined based on the status of the first page, the status of any additional pages, and any results of the preceding and following matching. The purpose of a field can relate to the topical or overall meaning or intended use or usefulness of the content related to that field. This purpose may reflect an obvious reason for using domains. In cases where domain resolution fails, or other access errors are returned, the intent may be that the domain is not in use or restricted. Other identified purposes may include pay-per-click (PPC) dwell, purposeful, covert redirects, retargeting, microblogging, etc., as detailed in Figure 2 below.

The result of this context-matching can be particularly effective in determining the purpose-specific determination of the active domain. The accuracy of this evaluation is increased by additional analysis of the additional pages following this prioritization. Thus, functional websites may be assigned non-unique purpose codes, such as those identified in Table 2, as well as any other suitable codes used to indicate other purposes.

Table 2:

Additional information may also be included in this purpose determination. For example, measurements of domain transactions, such as statistics from DNS transaction processors first, can be included to assess whether a website is an authorized retail site. Domain keywords, such as title, name, and description, may also be given assigned weights, in addition to the contextual match weighting factors described above. Domain properties, features and/or functions that indicate whether common features are present on the website and additional pages can be used to determine purposes such as blogging, retail, etc.

It may also be advantageous to take technical details of the content into account in determining the purpose. For example, identifying what type of technology the site uses, such as mail servers, cookies, multimedia, SSL certification for secure data, etc. associated with the domain, may provide an indication of purpose, such as retail or other purposes as opposed to individuals. Additional technical data beyond the specified content may also be indicative, such as the average time of presentation of the content on the relevant page, the geographical location of the web server, etc.

Embodiments may include determining the purpose of the domain based on determining at least one of domain name, registrant-reseller markup, absence of specified data types, alternate publishers of the pages, social group identification, and data types in the content. That is, the presence or absence of specific content, such as those listed above, may have independent significance in establishing the overall purpose of the field. Embodiments may include prompts for advertiser information, or the absence thereof, or data types such as image data, or the absence thereof. Once the purpose of the domain is determined, the method continues to step S1800.

In step S1800, the category of the domain may be determined, which is distinguished from each purpose of the domain. The category of the domain may reflect the category corresponding to the business sector related to the content on the site. This may involve determining which category the content from the first page and the additional pages belongs to. For example, the domain category might place the domain in a system of business classification taxonomy consistent with the North American Industrial Classification System. Table 3 is a partial list of exemplary categories that may include an assigned priority order for categories within the category code.

table 3:

The information used to determine the domain category may include content obtained from the first page and the additional pages, and possibly even the same content used to determine the purpose of the domain. However, the importance of information belonging to each may differ in each process. For example, as described above, the presence of "Ford" with other contextually relevant information can be used to determine the COMPANY/ORGANIZATION purpose of the web page. The presence of the same information "Ford" with other automobile information can also be used to determine the category of domains in the automobile domain.

As with the determination of the purpose of using this domain, this domain classification is not limited to the content of a particular web page. Rather, the domain classification may be derived from the content of the first page and the preferred additional pages to arrive at a comprehensive classification for the domain. Embodiments may also include identifying one or more domains based on their purpose, prior to performing classification of these domains. This may provide advantages in precise classification, such as dividing domains into classifications, with or without user interaction.

As discussed in embodiments of the present invention, the domain purpose and domain category characteristics can vary. That is, the domain purpose may include the purpose of the website related to the domain, such as news, blog, stay, etc. The purpose of the domain can be the primary purpose of the domain website. The purpose can relate to the content of that particular website without the company owning it. That is, the corporate website for the given company can have a different purpose than, for example, the company's promotion of a blog site.

After determining the domain category, the exemplary method may proceed to step S1900, with storing the result to a computer-readable storage medium, displaying the result to a user, or otherwise communicating the result electronically over an electronic communication network to at least one of the requesters. Embodiments may further include performing targeted searches in the stored data, and/or iteratively implementing the method across domains and compiling the results for historical analysis of the relevant domain space, as discussed further below Same.

Figure 4 depicts an example of a high-level process flow for a monthly iteration cycle in accordance with an embodiment of the present invention. It generally consists of inputs 610 , components 620 and outputs 630 . Additional tool 690 may also be included. Such additional tools may assist the user in implementing various selections/inputs 610, such as prioritizing recognized hyperlinks, words, and the like. The input may include, for example, a zone file 612 , a signature tag set 614 , and a training set 618 . In an embodiment, a user may enter or select items within the set of signature tags 614 and/or the training set 618 . The components may include a crawler 622 and an analyzer 624 . The analyzer can be functionally divided into category 626 and category 628 sections. Registry 616 may retain the various processes (inputs, components, and outputs) and implement them on designated portions of cyberspace 650 to better understand relevant online activities by industry sectors. For example, the registry may collect all DNS transactions from a given server. Data for all subdomain names of a TLD may be collected periodically and retained in file storage 632 for a period of time. A report 634 may also be generated based on the method including the training set 616 working in conjunction with the additional tool 690 to process information from the specified portion of the cyberspace 650 . This can provide DNS transaction values and domain status, purpose and type, for each domain name over time and provide access to information that has not been obtained in the past.

Embodiments may also include receiving a set of input domains from a user for analysis in step S2000 as part of the query. The system can automatically identify attributes that are common between these input fields. These attributes can come from between the contextual content or other aggregated information. The results of these analyzes may include outputting the identified common attributes to the user, in step S2100. This capability may provide advantages such as being able to automatically identify common purpose related attributes of domains, including the additionally identified pages.

Embodiments may also include receiving an input set of purposes and/or categories as part of the query in step S2000, such as from a user. Domains corresponding to the purpose and/or category of the input set may be identified based on the method, and the identified domains are output to the user, at step S2100. This capability may have the advantage of providing improved classification and identification of relevant information and/or domains that would not be possible only from commonly used web content analysis methods. The method can provide prioritization and resolution of downloaded content, identify and capture important attributes associated with a domain, including categories of direct and indirect content, and enable user or administrator searches based on attributes of the domain.

Additional details related to an exemplary process flow are provided in FIG. 6 . As shown in FIG. 6, the process may start at S600 and proceed to S610, where the target region file is acquired. For example, the target area may be a designated domain, as discussed herein. The method proceeds to S620.

In S620, the process attempts to connect to the target zone, which may be a specified domain. Different types of errors can be formed based on attempts to connect to the target area. For example, there may be useless delegations where the DNS server cannot operate. If no DNS is identified, or other errors similar to the above-mentioned ones occurring at S620, the method proceeds to S624, which is referred to as "No DNS" error. Based on this determination, a status may be reported at S680.

If the attempt to connect to the target area is successful, the method continues to S630. Successful attempts may include the requested domain name being resolved to an IP address by the DNS server. However, there are errors that can occur at the web server level that may prevent content from being fetched from the requested address. For example, at S634, a server error may be identified, such as the name server timing out, or otherwise indicating an error related to the server as a response to the request to connect to the IP address. If a server error is indicated at S634, the method may proceed to S680, where the error may be reported.

If a server is discovered by the server during S630, the method may proceed to S640-648, where various responses may be received based on attempts to crawl the specified website or address. This may include a prompt that the requested domain does not have an active website, as in S640. There may also be a bug with the web server responsible for prompting the website once it has been found, as in S642. The server or website may also restrict the web crawler's ability to retrieve content, as in S644, or redirect the web crawler to another site, as in S646. These and other responses in the form of incomplete access to the website content may be reported at S680.

If the website is evaluated and content is available, the method may proceed to S648, where the content at the website is identified as found. As described further herein, once content from the website or target domain is discovered, the method may continue by accessing and analyzing the discovered content, as in S660. Results of this content acquisition and/or analysis may be reported at S680.

The methodology described in Figure 6 may thus result in a number of various reports, at S680, based on how far the method has progressed through the attempted steps of accessing the target area. Some of these may reflect an impermissible state of the domain, as in the case of a DNS or web server error, or additional state, purpose and kind, based on the amount and type of information, including content obtained during this processing .

Embodiments of the present invention can include a system for implementing the method, as well as an encoded computer-readable storage medium having instructions for causing a computer to perform the method. For example, as shown in FIG. 5 , electronic system 100 including a processor, memory, and electronic communication device may be configured to identify the status of a first page associated with a domain through DNS server 140 . The system 100 may be represented as a user computer system, a wireless communication device such as 120, 170, a subnet such as 130, 190, a server, or any other network capable device having the necessary functional capabilities. System 100 may operate as part of a DNS server associated with a registry or independently of the DNS server.

The first page may be received by the system 100 from a server 150 over an electronic communication network 170 such as the Internet. The system 100 can identify additional pages from the domain based on hyperlinks from the first page. The system 100 can then identify the status of these additional pages through the DNS server 140 . The system 100 may also prioritize the hyperlinks based on a comparison with predetermined data, as described above. Content may be extracted from the first page and at least one of the plurality of additional pages by the server 150, 160, such as from a web hosting server. The system 100 may then process the content through a set of signature tags, either stored or otherwise electronically accessed by the system 100, to determine a contextual match.

The system 100 can further determine the purpose of the field based on the status of the first page, the status of the additional pages and the results of the content processing. The system 100 may receive various user inputs as described above, such as selection of identified web pages, selections from which data content is to be extracted, and the results of said processing performed by the system 100 may be displayed, stored and/or transmitted, according to known technology.

The system 100 includes any number of storage devices coupled to storage devices including first storage (not shown, typically random access memory, or "RAM"), second storage (not shown, typically read-only memory, or "ROM") processor (not shown). These storage devices may each include any suitable type of computer-readable media described and/or referred to above. Primary storage (not shown) may also be used to store programs, data, etc. and is typically a secondary storage medium such as a hard disk that is slower than primary storage. It will be appreciated that it is possible, where appropriate, to incorporate information retained within the main storage means in a standard manner as part of the main storage, as virtual memory. A designated primary storage device such as a CD-ROM can also transfer data to the processor without direction.

The system 100 may also include an interface including one or more input/output devices such as a video monitor, trackball, mouse 104, keyboard, microphone, touch sensitive display, conductive card reader, magnetic or paper tape reader , tablet, stylus, voice or handwriting recognizer or other known input devices, including other computers 110. The system 100 can be coupled to a computer or other electrical communication network 170, 180 using the network connection shown generally at 101. The network can connect various wired, optical, electronic and other known networks to exchange information between computers 110, servers 160, wireless communication devices 120, 170 and subnets 190, 130. Using such a network connection, it is contemplated that the system 100 and processors therein may receive information from, or output information to, the network in the course of performing the method steps described above. The above-mentioned means and materials will be well known to those skilled in the computer hardware and software arts and need not be described independently or completely for the understanding of those skilled in the art. The hardware elements described above may be configured (usually temporarily) as one or more modules for performing the operations described above.

In addition, embodiments of the present invention further include computer-readable storage media including program instructions for implementing various computer-implemented operations. The medium may also include, alone or in combination with the program instructions, data files, data results, tables and the like. The media and program instructions may be those specially designed and constructed for the subject matter, or they may be of the type available to those skilled in the computer software arts. Examples of computer-readable storage media include magnetic media, such as hard disks, floppy disks, and magnetic tape; optical media, such as CD-ROM disks; magneto-optical media, such as optically readable disks; and hardware specially configured to store and implement program instructions devices such as read-only memory (ROM) and random access memory (RAM). Examples of program instructions include both machine code as produced by an editor and files containing higher level code executable by the computer using an interpreter.

The invention has been described with reference to exemplary embodiments. Modifications and alterations to the described embodiments will be apparent to those of ordinary skill in the art upon a reading and understanding of the specification. The present invention is intended to embrace all such modifications and changes, as they come within the scope of the appended claims or their equivalents.

Claims (14)

1. determine to comprise the automated process that domain name illustrates:

A () identifies the running status of this first webpage relevant to this domain name by attempting parsing first webpage;

If b the trial of this first webpage of () this parsing leads to errors, the running status based on this first webpage determines the object of this domain name;

If c (), only when the trial and success of this first webpage of this parsing, proceeds to step (d)-(j);

D () is by attempting finding the first webpage of this domain name to identify this running status further by computer communication network;

E () identifies the multiple additional web pages relevant to this domain name based on the hyperlink found from this first webpage;

F () is by attempting resolving the running status that this additional web pages identifies these additional web pages;

(g) based on predefined data compare the priority determining the hyperlink found from this first webpage;

H () extracts content by this computer communication network from least one page in this first webpage and the plurality of additional web pages, at least one page in the plurality of additional web pages selects based on this priority;

I () is mated to determine the front and back existed in this content by this content of list processing (LISP) of predetermined related data element;

J () is based on the running status of this first webpage, the running status of this additional web pages and mate by the front and back that go out of this content recognition of process the object determining this domain name; With

K () determination object to this domain name shows, stores and sends one of at least.

2. an automated process for analysis domain, comprising:

By attempting resolving the first page relevant to territory and attempting finding this first page to identify the running status of this first page;

Find this first page;

The multiple additional page from this territory are identified based on the hyperlink from this first page;

Identify the running status of these additional page;

Based on predefined data compare the priority determining this hyperlink;

Extract content from least one page in this first page and the plurality of additional page, at least one page in the plurality of additional page selects based on this priority;

Mated before and after determining by this content of signature label sets process;

The object in this territory is determined according to the running status of this first page, the running status of this additional page and the result that processes this content; With

Show, store and send one of at least to the determination object in this territory.

3. method as claimed in claim 2, wherein in this content, the object determining this territory further based on determining the lacking of domain name, registrant's reseller mark, specified data type, the replacement of these pages announces at least one in people, societies mark and data type.

4. method as claimed in claim 2, comprises further:

Based on this one or more territory of object identification; With

Determine the kind of this differential threshold, be different from the various species in the territory of each object in this territory.

5. method as claimed in claim 4, comprises further and identifies based on the determination kind in this territory and fundamental purpose and find the domain of dependence.

6. method as claimed in claim 2, comprises further and identifies based on the determination state in this territory and object and find the domain of dependence.

7. method as claimed in claim 2, wherein this content comprises the executable code be embedded in this first page or these additional page, and this signature label sets is configured to determine that the front and back in this executable code are mated.

8. method as claimed in claim 2, wherein this content comprises the image, the Audio and Video information that are embedded in this first page or these additional page, and this signature label sets is configured to determine that the front and back in this image, Audio and Video information are mated.

9. method as claimed in claim 2, the follow-up hyperlink wherein from this first page comprises the https version transmitting and be redirected to this first page.

10. method as claimed in claim 2, comprises further:

From the input set of user's acceptance domain;

Identify from the predicable in the input domain before and after this between matching content; With

The attribute this identified exports to this user.

11. methods as claimed in claim 2, comprise further:

The input set of object is received from user;

Identify should the territory of object input set; With

This differential threshold is exported to this user.

12. methods as claimed in claim 4, comprise further:

The input set of object and kind is received from user;

Identify should the territory of input set of object and kind; With

This differential threshold is exported to this user.

13. methods as claimed in claim 2, wherein:

Identify that this first page state comprises:

Attempt the domain name of resolving this first page;

If this domain name mapping failure, by the state recognition in this territory for running; With

If this domain name mapping, but content cannot be accessed, by this state recognition for accessing, and

Identify that these additional page states comprise:

Attempt domain name or the network address of parsing first additional page;

If this domain name or network address translation failure, by the state recognition of this first additional page for running; With

If this domain name mapping, but content cannot be accessed, by the state recognition of this first additional page for accessing.

The automatic system of 14. 1 kinds of analysis domains, comprising:

For the device at electric network exchange data;

For also attempting finding this first page to identify the device of the running status of this first page by attempting resolving the first page relevant to territory;

For finding the device of this first page;

For identifying the device of the multiple additional page from this territory based on the hyperlink from this first page;

For identifying the device of the running status of these additional page;

For based on the device comparing the priority determining this hyperlink with predefined data;

For extracting the device of content from least one page in this first page and the plurality of additional page, at least one page in the plurality of additional page selects based on this priority;

For passing through this content of signature label sets process to determine the device of front and back coupling;

For determining the device of the object in this territory according to the running status of this first page, the running status of this additional page and the result that processes this content; With

For the device showing respectively the determination object in this territory or store.