HK1082142B - Method and apparatus for measuring communication market statistics - Google Patents

Description

Method and apparatus for measuring communication market statistics

Cross Reference to Related Applications

This application claims priority to U.S. provisional application No.60/369339 filed on 3.4.2002, U.S. provisional application No.60/369326 filed on 3.4.2002, and U.S. provisional application No.60/407700 filed on 4.9.2002. The entire contents of these provisional applications are expressly incorporated herein by reference.

Technical Field

The invention relates to measurement of communication market statistics. More particularly, the present invention relates to a method and apparatus for measuring market statistics for a communication market service provider.

Background

Over the last two decades, wireless communication services have transitioned from richly populated toys and identity symbols to an indispensable communication tool for the average population. Currently, wireless penetration in the united states is about 50%. That is, half of the 2.8 million population in the united states subscribe to wireless communication services. With the development of the wireless communication industry, competition for users continues to be intense. For example, some wireless communication markets were originally served by only two Wireless Service Providers (WSPs), and are now served by up to nine wireless service providers. Thus, each wireless service provider competes with many other wireless service providers for users in a particular market.

As competition between wireless service providers increases, and as market conditions typically change rapidly on a market-by-market basis, wireless service providers need to obtain reliable market statistics about themselves and their competitors in order to make strategic and tactical decisions. Because wireless service providers are competing for the same user, these wireless service providers are reluctant to share market information with their competitors. It is therefore desirable to obtain reliable market information measurements, such as market share information, about competitors in the wireless services market.

One technique for obtaining market share information is through the use of traditional surveys. These surveys involve asking a series of questions by means of, for example, telephone communication means, written communication means or oral communication means. However, such surveys typically have very low sampling rates due to the cost they spend. In addition, these surveys may have biases that distort the results, as consumers have vague knowledge of wireless communication services. For example, many people respond by the name of their wireless handset manufacturer, rather than the name of the wireless service provider, when asking someone which wireless service provider to subscribe to. The high cost, low sampling rate and bias of these traditional surveys do not provide adequate results from which a wireless service provider can make business decisions.

Another technique for obtaining market share information is known as dial-down technology (dialup). Currently, each wireless service provider is assigned a range of telephone numbers, referred to as a line range, from which they can be reassigned to wireless subscribers. To accommodate new subscribers, wireless service providers only assign a limited number of telephone numbers in the line range to subscribers at any particular point in time. Thus, the dial-down technique requires the employment of many operators to dial the range of lines that have been assigned to a particular wireless service provider. These operators then listen to the call connection to determine whether a particular number within the line range has been assigned to the subscriber. The use of operators listening to call connections is very costly and time consuming. The costly and time consuming nature of this technique results in a lower sampling rate. Thus, this technique fails to provide adequate results from which a wireless service provider can make business decisions.

One updated technique for obtaining market share information is known as Over The Air (OTA) technique. This technique involves placing a dedicated receiver throughout a particular market that is used to collect data transmitted on a control channel between a wireless device and a wireless network. In particular, many wireless standards employed in the united states require the transmission of a wireless device's Mobile Identification Number (MIN) between the wireless network and the wireless device. The MIN is transmitted between the network and the wireless device when the wireless device is powered on, powered off, receiving an incoming call, initiating an outgoing call, and when the wireless device is powered on to await a call to be initiated or received. Thus, these dedicated receivers will collect MINs from the forward control channel and record each MIN transmitted between the wireless device and the network. After a period of time, the number of unique MINs received by the dedicated receiver is taken as a statistical sample of the number of MINs assigned within a particular line range.

Although the over-the-air technique is more accurate and generally less costly than previous techniques, it also suffers from a number of drawbacks. For example, there is a certain percentage of wireless users that use their wireless devices only in emergency situations. Similarly, some users of wireless devices travel outside for long periods of time, away from their home market. Thus, over-the-air technology is likely to be unsuitable for these users. In addition, aerial technology requires the expense of dedicated receivers, as well as the labor costs for installing and removing such receivers from a location. Moreover, some communication standards, such as global system for communications (GSM) and Integrated Digital Enhanced Network (iDEN), do not transmit MINs over the forward control channel, making this technique useless for measuring these types of systems. Furthermore, it is difficult and inaccurate to employ over-the-air techniques to obtain accurate measurements regarding frequent subscriber changes and total increases. In addition, portability of local numbers also increases the complexity of over-the-air technology.

It is therefore desirable to provide a method and apparatus that can provide statistically accurate estimates of market statistics without the high cost, low sampling rate and technical obstacles of the prior art. It is also desirable to provide other measurement data than market share, such as frequent service provider changes by users and total increases.

Disclosure of Invention

The present invention provides a method and apparatus for determining market statistics for a communication service provider. In particular, the present invention utilizes the determination of whether a sample of telephone numbers are assigned by a particular service provider to determine market statistics. In accordance with one embodiment of the present invention, a query to a local number portability database is utilized to determine whether a telephone number has been assigned by a service provider. These queries are also used to collect statistics regarding the porting of telephone numbers between service providers. According to another embodiment of the invention, the response is obtained using a message. The response is interpreted to determine whether a telephone number associated with the wireless device has been assigned. According to another embodiment of the present invention, a sample of telephone numbers is dialed over a digit line. It is determined whether the telephone number has been assigned by the service provider based on the result of the dialing. The invention is also applicable to telephone numbers that have been ported between service providers in a network employing local number portability.

Drawings

Other objects and advantages of the present invention will become apparent to those skilled in the art upon a reading of the following detailed description of the preferred embodiments when taken in conjunction with the drawings wherein like reference numerals identify like elements and wherein:

FIG. 1 illustrates a method for measuring market statistics in accordance with an exemplary embodiment of the present invention;

FIG. 2 illustrates a method for initializing a system for measuring market statistics in accordance with an exemplary embodiment of the present invention;

FIG. 3 illustrates a table of wireless service providers and associated line ranges in accordance with an exemplary embodiment of the present invention;

FIG. 4 illustrates a table of service providers and associated telephone numbers in a system that employs local number portability in accordance with an exemplary embodiment of the present invention;

FIG. 5 illustrates a system for measuring market statistics in a system that employs local number portability in accordance with an exemplary embodiment of the present invention;

FIG. 6 illustrates an exemplary method incorporating the first, second and third embodiments of the present invention;

FIG. 7 illustrates a signaling diagram for measuring market statistics in a system employing local number portability in accordance with an exemplary embodiment of the present invention;

FIG. 8 illustrates an exemplary system for measuring market statistics in accordance with a second embodiment of the present invention;

FIG. 9A illustrates a first alternative system for measuring market statistics in accordance with a second embodiment of the present invention;

FIG. 9B illustrates a second alternative system for measuring market statistics in accordance with the second embodiment of the present invention;

FIG. 10 illustrates an exemplary method for testing telephone numbers according to a second embodiment of the present invention;

FIG. 11 illustrates an exemplary signaling diagram for testing telephone numbers in accordance with a second embodiment of the present invention;

FIG. 12 illustrates a detailed exemplary method for testing telephone numbers according to a second embodiment of the present invention;

FIG. 13 illustrates an exemplary system for measuring market statistics in accordance with a third embodiment of the present invention;

FIG. 14 illustrates details of an exemplary system for measuring market statistics in accordance with a third embodiment of the present invention;

FIG. 15 illustrates a detailed exemplary method for testing telephone numbers according to a third embodiment of the present invention;

FIG. 16 illustrates an exemplary signaling diagram for testing telephone numbers in accordance with the third embodiment of the present invention;

FIG. 17 illustrates an exemplary method for interpreting test results according to a third embodiment of the present invention;

FIG. 18 illustrates an exemplary method for initializing the system to interpret the test results of a telephone number in accordance with the third embodiment of the present invention;

fig. 19 illustrates an exemplary table for explaining test results of telephone numbers according to the third embodiment of the present invention;

FIG. 20 illustrates a method for calculating statistical data according to an exemplary embodiment of the present invention;

21A-C illustrate tables of measured market statistics in accordance with exemplary embodiments of the present invention; and

figures 22A and 22B illustrate tables of measured market statistics for a system that employs local number portability in accordance with exemplary embodiments of the present invention.

Detailed Description

FIG. 1 illustrates a method for measuring market statistics in accordance with an exemplary embodiment of the present invention. The method shown in fig. 1 is common to all of the first, second and third embodiments of the present invention. The overall process of the invention involves: initializing the system (step 110); testing a telephone number (step 120), such as MIN, Mobile Directory Number (MDN), etc.; and calculating statistical data using the tested phone numbers (step 130).

Fig. 2 illustrates a method for initializing the system of the present invention. Initially, a relevant market for which statistical data is collected is defined (step 210). To determine market statistics, the present invention tests MINs to determine whether they are assigned to a user. It will be appreciated that in the united states the MIN is in the form NPA-NXX-XXXX, where NPA is the area code, NXX is the central office switch code, and XXXX is the extension number. Thus, the control computer of the system of the present invention is loaded with NPA-NXX and/or NPA-NXX-X ranges for all wireless service providers that are serving a market of interest, such as a city, county, area code, or metropolitan area.

It will be appreciated that the NPA-NXX information represents 10000 MINs, and that the wireless service provider associated with a particular NPA-NXX is available from the north american telephone numbering plan association (NANPA). It will also be appreciated that the NPA-NXX-X information represents 1000 MINs, and that the wireless service providers associated with a particular NPA-NXX, NPA-NXX-X, NPA-NXX-XX, NPA-NXX-XXX, and/or NPA-NXX-XXXX are available from the Local Exchange Routing Guide (LERG). Other sources of information about which wireless service provider a particular line range belongs to may also be available, such as a cross over (Crossroad) database of TSI teleservice companies.

Fig. 3 illustrates an exemplary table of wireless service providers and their associated line ranges. As shown in fig. 3, a wireless service provider, such as wireless service provider a, may be assigned 3 NPA-NXX line ranges. In addition, another wireless service provider, such as wireless service provider B, may be assigned one full NPA-NXX line range and several NPA-NXX-X line ranges. As shown in fig. 3, when a wireless service provider is assigned a portion of the NPA-NXX line range, the wireless service provider can be assigned anywhere from 1 to 10000 telephone numbers. As also shown in fig. 3, wireless service provider B has one full NPA-NXX line range and two partial NPA-NXX line ranges. As shown in fig. 3, wireless service provider a has 30000 assignable MINs, while wireless service provider B has 20000 assignable MINs. If wireless service providers a and B are the only wireless service providers for the market, there are 50000 MINs in the market that can be assigned to the subscriber.

Turning to FIG. 2, after a market has been defined (step 210), a sample rate for the measurement is determined (step 220). It will be appreciated that it is not necessary to sample all possible MINs in the market to obtain reliable market statistics. A much lower sampling rate, e.g., 2-5%, may provide reliable market statistics within a certain statistical confidence interval. This sampling rate is combined with the total number of MINs in the market that can be assigned to the subscriber. Thus, taking the market as shown in the table of figure 3 as an example, if a sampling rate of 5% is desired, then 2500 MINs would be tested separately.

After the sampling rate is determined (step 220), the system generates a random MIN for testing (step 230). With a sampling rate of 5% for the market as shown in fig. 3, 1500 unique MINs (5% 30000) would be randomly generated for wireless service provider a and 1000 unique MINs (5% 20000) would be randomly generated for wireless service provider B. The present invention may also generate random MINs at the NPA-NXX-XX or NPA-NXX block level or any other level, if necessary. These MINs in the randomly generated MIN list are referred to as test MINs. It will be appreciated that the generation of random numbers within a particular range is well known in the art and, therefore, the manner in which the numbers are generated is not described in detail.

After the system has been initialized, the telephone number, e.g., MIN or MDN, is tested. The manner in which the MIN is tested (step 120) differs in the first, second, and third embodiments of the present invention.

Currently, the Federal Communications Commission (FCC) requires wireless service providers in the major markets in the united states to implement Wireless Local Number Portability (WLNP) by 11 months of 2003. Wireless local number portability allows a subscriber to retain a telephone number when the subscriber changes service providers. In the case of wireless local number portability, the telephone number is referred to as a Mobile Directory Number (MDN). The process of reserving the same MDN when changing service providers is referred to as "porting" the number. Wireless local number portability will allow telephone numbers to be ported from one wireless service provider to another. Another proposed improvement in local number portability includes porting telephone numbers from a landline service provider to a wireless service provider and from a wireless service provider to a landline service provider. Today, landline numbers can be ported from one landline service provider to another. The scope of the invention will be applicable to wireless and landline portability.

Once wireless local number portability is achieved, the MDN will no longer be an attribute of the wireless service provider. While the MDN will be an attribute of the user who is free to migrate the MDN from one communication provider to another communication provider within the same geographic area. Thus, over time, 10000 MDNs in the line range originally assigned to a wireless service provider may contain MDNs assigned to other wireless service providers or landline service providers. The movement of the MDN from one service provider to another is illustrated in fig. 4.

Figure 5 illustrates an exemplary system for measuring market statistics in a market to which local number portability is applied. The market shown in fig. 5 has six wireless service providers WSP a-WSP F. As shown in fig. 5, these wireless service providers may employ any type of air interface standard such as AMPS, TDMA, GSM, CDMA, and iDEN. The techniques described below in connection with the second and third embodiments of the invention may be implemented in a system as shown in fig. 5. Specifically, according to the second embodiment of the present invention, the computer 505 controls the test apparatus 510 to query the HLR with a "query with permission" type message. Similarly, according to the third embodiment of the present invention, the computer 505 may initiate a call over a digital line, such as an ISDN or T1 link.

To address wireless local number portability, the present invention includes information stored in Local Number Portability (LNP) database 515 for determining whether a telephone number has been ported and when to calculate market statistics. The local number portability database will be updated and maintained by various companies, including, for example, TSI carriers and VeriSign carriers (formerly illuminets). As shown in fig. 5, the local number portability database will be accessible via the SS7 network. The local number portability database is intended for use in obtaining Destination Point Code (DPC) information for routing calls. It will be appreciated that the destination point code is similar to an IP address, except that the destination point code identifies a network node in order for the SS7 network to properly route calls. The access to the local number portability database and the receipt of the returned information is referred to as the database "DIP".

Fig. 6 illustrates an exemplary method describing the relationship of the first, second and third embodiments of the present invention. In particular, fig. 6 illustrates an exemplary method for testing telephone numbers to determine whether a telephone number is assigned. Initially, a determination is made as to whether the telephone number is a portability telephone number (step 610). This determination is made by consulting the LERG which contains a field indicating for each line range whether a particular line range is portable or not. If the telephone number is not a portable telephone number ("no" path out of decision step 620), the telephone number is then tested using the second or third embodiment of the present invention (step 620), as will be described in more detail below.

If it is determined that the telephone number is a portable telephone number ("yes" path out of decision step 610), a query is sent to the local number portability database regarding the telephone number (step 630). Next, a determination is made as to whether the response received from the local number portability database contains a Local Routing Number (LRN) (step 640). If the local number portability database response does not contain a local routing number ("no" path out of decision step 640), the telephone number is tested (step 620) using the second or third embodiment of the present invention, which will be described in more detail below. If, however, the local number portability database response contains a local routing number ("yes" path out of decision step 640), the telephone number is marked as assigned and the service provider associated with the telephone number is set based on the local routing number (step 650). The test is then repeated for each telephone number in the list of test telephone numbers. It should be appreciated that the method as shown in fig. 6 may be modified to be accomplished using only the local number portability database. In particular, the local number portability database will represent a statistical sampling of the market. This modification would cancel the "no" path in decision steps 610 and 640 and according to this method step 620 is cancelled.

The present invention utilizes the local routing number to determine which service provider a particular MDN is currently being served by. This determination may be accomplished by using a look-up table that associates local routing numbers with service providers, such information being available from the Local Exchange Routing Guide (LERG) of Telcordia or other such information source. If the MDN has been ported, the computer 505 updates its database to reflect the new service provider associated with that particular MDN. Since the LNP database is required to contain the ported MDN, all MDNs defined in this database are assigned. The unassigned ported telephone number needs to be returned to the donor/local wireless service provider and thus deleted from the LNP database. Assume that the ported MDN is to be assigned. Of course, the system may use the second and/or third embodiments of the present invention to test MDNs if necessary. With MDN porting information, the generation of market statistics, described in detail below, may account for the fact that a wireless service provider may not occupy all telephone numbers within a particular line range.

Fig. 7 illustrates signaling for the local number portability database DIP in accordance with an exemplary embodiment of the present invention. The computer sends a message to the SS7 test device instructing the SS7 test device to execute the local number portability database DIP. The message sent from the computer includes an MDN requesting a database DIP. The SS7 test equipment sends an SS7DIP message including an MDN to the local number portability database. As shown in fig. 7, the particular local number portability database to which SS7DIP messages are sent may be a database of MDNs and/or landline telephone numbers. The local number portability database responds with an SS7DIP response message containing the MDN and the local routing number. If the MDN has not been ported, the LRN field in the SS7DIP response message will not contain a local routing number. If the MDN has been ported, the SS7DIP response message will contain the local routing number in the form of a destination point code. The SS7 test device forwards the DIP response to the computer.

According to a second embodiment of the present invention, the IS-41 Mobile Application Part (MAP) functionality of the SS7 Transaction Capabilities Application Part (TCAP) IS employed. Figure 8 illustrates an exemplary system for testing MINs in accordance with the second embodiment of the present invention. The system shown in fig. 8 includes a computer 810, signaling system 7 (SS7) test equipment 820, an SS7 network 830, a wireless service provider a 840, and a wireless service provider B845.

Computer 810 can be any computer commercially available, such as the Dell desktop computer, which runs the Microsoft Windows XP operating system. The SS7 test device 820 may be any available SS7 test device, such as Sentiel by Tekelec, Spectra by Inet, or Signaling Advisor by Agilent. The SS7 network represents the entire SS7 network extending throughout the country and world. Wireless service provider a 840 and wireless service provider B845 represent the networks of these service providers.

As shown in fig. 8, computer 810 is connected to control SS7 test equipment 820. If the computer 810 and the SS7 test equipment 820 are co-located, the two devices may be connected either by a standard serial link (RS-232-C) or by a standard Ethernet connection (10 BaseT). If computer 810 and SS7 test equipment 820 are not co-located, these devices may be connected using various known methods, such as a leased telephone line, a dial-up modem, or an Internet connection. Although the computer 810 and the SS7 test equipment 820 are shown as separate parts, they may be combined into one part, for example the SS7 test equipment 820 may contain a control program running on the computer 810. The SS7 test equipment 820 is typically connected to the SS7 network through the commercial network of a wireless service provider. Specifically, the SS7 test equipment 820 is typically located between wireless service provider equipment, such as in a switch room, or connected to the provider's equipment through an external link (e.g., T1). It should be noted that the SS7 test equipment 820 need not be located in the same market as the MIN to be tested.

Fig. 9A illustrates an exemplary system according to a second alternative of the second embodiment of the invention. As depicted in fig. 9A, computer 810 is connected to SS7 test equipment 820 via a 100 megabit ethernet connection. The computer 810 is also connected to a statistics server 990 via a 100 megabit ethernet connection. Statistics server 990 collects market statistics processed by computer 810. However, the statistics server is not an essential component of the present invention. In the embodiment shown in fig. 9A, SS7 test equipment 820 is connected to an SS7 network via Signal Transfer Points (STPs) Alpha 950 and Beta 960. In particular, SS7 test equipment 820 is connected to a signal transfer point via a conventional a-link.

Fig. 9B illustrates an alternative technique for connecting to an SS7 network in accordance with the present invention. In the embodiment shown in fig. 9B, the SS7 test equipment has monitor links to two a-links, and a new a-link to the signal transmission point Beta 960, rather than a direct a-link between the SS7 test equipment 820 and the two signal transmission points Alpha 950 and Beta 960. It will be appreciated that the new a-link may also reach signal transmission point Alpha 950, although such redundancy is not required.

The new a-link is assigned a test point code. SS7 test equipment 820 sends messages over the new a link using the same origination point code as Mobile Switching Center (MSC) 980. Since the test messages are sent over the a-link, mobile switching center 980 cannot see the outgoing test messages sent by SS7 test equipment 820. Likewise, SS7 test equipment 820 cannot see outgoing mobile switching center messages sent by mobile switching center 980. The mobile switching center will receive a response to messages sent over the new a-link but the mobile switching center will ignore these messages. SS7 TCAP messages have transaction IDs that uniquely identify each message. The test message contains transaction IDs which do not conflict with the transaction ID of the mobile switching centre, i.e. they utilize mutually different transaction IDs. Similarly, SS7 test equipment 820 ignores messages intended for mobile switching center 980. It will be appreciated that the connections shown in fig. 9A and 9B are merely exemplary and those skilled in the art may connect to the SS7 network in other ways.

Fig. 10 illustrates an exemplary method for testing a phone number according to a second embodiment of the present invention. Fig. 11 illustrates exemplary signaling between various system nodes according to a second embodiment of the present invention. Initially, a test message is generated by SS7 test equipment 820 under the control of computer 810 (step 1010). As described above, the second embodiment uses the IS-41/MAP function of the SS7 TCAP to test telephone numbers. Thus, the second embodiment of the present invention employs a "query with permission" type message to test the telephone number. According to an exemplary embodiment of the present invention, a qualifications request message ("QUALREQ") is employed to test a telephone number. It will be appreciated, however, that other types of "query for permission" messages may be employed, provided that a response to such a message is able to identify whether a telephone number has been assigned to the user.

As shown in fig. 11, computer 810 sends an initialization "query for permission" type message to SS7 test equipment 820. The "QUALREQ" message employs two main variables, namely MIN and Electronic Serial Number (ESN). The ESN is a unique 8-bit hexadecimal number that is unique to a particular wireless device. The ESN has been programmed into the wireless device during manufacture and cannot be modified or changed thereafter. When a subscription of a wireless device to a wireless service provider is activated, the wireless service provider assigns a MIN to the wireless device and stores the relationship between the assigned MIN and the ESN of the wireless device in a Home Location Register (HLR) of the wireless service provider. When a wireless device makes an authentication attempt, the HLR determines whether the MIN/ESN pair sent by the wireless device matches the stored MIN/ESN pair for that particular wireless device. If there is a match, the user is authorized. If not, the authentication attempt fails.

According to a second embodiment of the present invention, rather than using a "QUALREQ" message for authentication, this message is used to determine whether a particular MIN has been assigned. Additionally, the computer 810 and the SS7 test equipment 820 do not know the ESN associated with a particular MIN. Thus, the present invention employs a default ESN, such as B3EE1C17, with each MIN in a "query with permission" type message. As shown in fig. 11, after receiving the initialization instruction, the SS7 test equipment 820 sends a "permission query" message to the HLR of the wireless service provider via the SS7 network (step 1020).

Upon receiving the "query with permission" type message, the HLR checks its database to determine if the MIN/ESN pair in the message matches the MIN/ESN pair stored in the database. Because the present invention employs a default ESN, the MIN/ESN pair in the "query with permission" type message does not result in authentication. Thus, a "permit query" type response sent by the HLR to the SS7 test equipment will contain an error message with an explanation as to why the authentication failed. The "permissive query" response is forwarded by SS7 test equipment 820 to computer 810. The computer 810 interprets the error message to determine if a MIN is assigned (step 1030).

Possible responses to the "query allowed" message include "unidentified MIN", "HLR/MIN mismatch" and "unassigned directory number". These messages are interpreted as test MINs not being assigned. Other possible responses are "invalid serial number" and "unidentified ESN," which are interpreted as test MINs being assigned because the default ESN does not match the information in the HLR. It will be appreciated that the particular response to the "query with permission" type message depends on how the HLR for a particular network is managed. Thus, there may be responses to "query allowed" type messages other than those listed above. These responses contain error codes that can be interpreted to determine if a MIN has been assigned. After interpreting the response to the "query with permission" type message, the computer 810 stores the results of whether the test MIN is assigned (step 1040). The second embodiment according to the present invention allows a large number of MINs to be tested in a short period of time. For example, 3 to 15 MINs can be tested per second.

Fig. 12 illustrates a more detailed method for testing telephone numbers according to a second embodiment of the present invention. If a next job is available, computer 810 loads the next job into SS7 test equipment 820 (step 1205). It is then determined whether there are more MINs to query in the loaded job (step 1210). If there are no MINs to query in the load job ("NO" path out of decision 1210), then the next job is loaded (step 1205).

If there are more MINs to query in the load job ("yes" path out of decision step 1210), then the next MIN and associated destination point code are retrieved from the database of computer 810 (step 1215). The specific message used to test the MIN is a "QUALREQ" message. Accordingly, the QUALREQ message is encoded and transmitted to the home location register according to the destination point code (step 1220). It is then determined whether a message has been received in response to the QUALREQ message (step 1225). If a message has not been received ("no" path out of decision step 1225), a determination is made as to whether a timeout has occurred (step 1230). SS7 message response times are typically less than 1 second. This embodiment employs a timeout value of 5 seconds, however, network specific conditions may require adjustment of this value. If not (decision no path in decision step 1230), the system continues to wait for a response message to be received (step 1225). However, if a timeout has occurred ("yes" path out of decision step 1230), then a determination is made as to whether there are multiple MINs to query (step 1210).

The particular type of message received in response to the QUALREQ message is referred to as the "QUALREQ" response. Thus, if a qualreq response message has been received ("yes" path out of decision step 1225), then the qualreq message is decoded to determine the message type, the origination point code, the corresponding transaction ID, and the private error/rejection cause (step 1235). It is then determined whether the decoded fields match (step 1240). The destination point code of the outgoing QUALREQ message is matched to the origination point code of the incoming QUALREQ response. In addition, the originating transaction ID of the QUALREQ is matched to the responding transaction ID of the QUALREQ. Furthermore, the message type of the received qualreq response must be either a TCAP return error or a TCAP return result. The private error/reject cause determines whether the MIN is assigned or unassigned. If the decoded fields do not match ("no" path out of decision step 1240), a determination is made as to whether a timeout has occurred (step 1230). However, if the decoded fields match (decision step 1240, "yes" path), then the test result for the MIN is set in the database of computer 810 as "assigned" or "unassigned" based on private error/rejection reasons (step 1245).

Fig. 13 illustrates an exemplary system according to a third embodiment of the present invention. A third embodiment of the present invention uses a digital connection to the SS7 ISDN user part (ISUP) network to test MINs. In particular, the third embodiment of the present invention employs digital messages, in-band tones, and voice announcements received over a digital connection. The digital messages include 'connect' messages and 'unassigned number' messages; the in-band tones comprise fast busy tones, silence tones and ringing tones; the voice notification includes a prerecorded voice message sent by the telephone network, such as "the number you call has stopped servicing".

Fig. 13 shows a customer premises 1310 connected to a Central Office (CO)1320 in an SS7 network by one analog connection and two digital connections. These two digital connections are simply extensions of the ISUP portion of the SS7 network. The subscriber premises include a standard analog telephone 1330 connected to a Central Office (CO)1320 through an analog connection, and a digital telephone 1340 and computer 1350 connected to the Central Office (CO)1320 through a digital connection. Although fig. 13 shows the customer premises directly connected to the SS7 network, it is understood that the customer premises may also be connected to the SS7 network via the internet. The connection to the SS7 network via the internet has the advantage that it does not require ISDN terminal adapters and central offices, saving equipment costs and ISDN lines.

Figure 14 shows in detail the digital connection between the computer 1350 and the central office 1320. Specifically, computer 1350 is connected to an Integrated Services Digital Network (ISDN) terminal adapter 1410. The terminal adapter 1410 may be a separate component that is connected to the computer 1350 via, for example, 10BaseT or RS-232-C, or may be an internal component such as a PCI card. A specific example of such a terminal adapter is the EICON DIVA Server PRI/T1. The digital connection between computer 1350 and central office 1320 may be an ISDN Basic Rate Interface (BRI), a primary group rate interface (PRI) or a T1 line (in the united states) or an E1 line (in europe).

A BRI consists of two bearer (B) channels and one data (D) channel, which is commonly referred to as 2B + D. The data rate for the B channel is 64kbps and the data rate for the D channel is 16 kbps. The bearer channel carries user information, such as user data or digitized voice, while the data channel carries packetized user data, such as x.25 data and call control information. The PRI is composed of 23B channels with a data rate of 64kbps and 1D channel with a data rate of 64 kbps. PRI is commonly referred to as 23B + D. Similar to PRI, the data rate of T1 was 1544 kbps. However, T1 supports 24 bearer channels, which employ signaling on the bearer channels using certain bits of certain frames for control information. It will be appreciated that the ISDN terminal adapter may interface with PRI or T1 lines, and therefore, in the following, PRI and T1 will be referred to together as PRI/T1. The function of BRI or PRI/T1 is the same, and BRI or PRI/T1 is selected based on the capacity required. Since PRI/T1 has more bearer channels than BRIs, the capacity of PRI/T1 is 11.5/12 times the capacity of BRIs.

Figure 15 illustrates an exemplary method for testing MINs in accordance with the third embodiment of the present invention. Initially, computer 1350 dials the MIN through a digital message (step 1510). If the computer uses PRI/T1 for the connection, 23/24 MINs may be dialed simultaneously. In addition to dialing the MIN, the ISDN terminal adapter sends information to establish the "initial B channel connection". The initial B channel setup allows computer 1350 to receive in-band signaling information on the B channel, such as ring tones and termination notifications, before receiving any possible 'connect' indications. A 'connect' message is a digital message received from the network indicating that the remote has responded. In addition to the 'connect' message, there are other numeric messages that can be used to classify MINs (e.g., unassigned numbers). The initial B channel establishment forms a reverse B channel communication path from the central office 1320 to the ISDN terminal adapter 1410. Typically, this reverse path is formed after the 'connect' message is received. When the MIN is dialed, an acknowledgement is sent from the far end acknowledging receipt of the call, and the packet then begins to arrive from the network to the ISDN terminal adapter. Accordingly, the present invention interprets the received data packet to determine if a MIN is assigned (step 1520). Finally, the result of whether the MIN is assigned is stored (step 1530).

Fig. 16 illustrates signaling associated with the method of fig. 15. As shown in fig. 16, there are three possible cases when classifying MINs. If the connect message is received by the ISDN terminal adapter 1410, then it is determined that a MIN is assigned. If the call is answered by the subscriber or the voice mail system, the central office sends a 'connect' message to the ISDN terminal adapter. The ISDN terminal adapter immediately sends this indication to the computer and the computer terminates the call by sending a release message within a few milliseconds. The control computer then marks the particular MIN as assigned.

If no connect message is received, the data packets received over the bearer channel are tested to determine the class of MIN. Specifically, the system stores data packets received up to 2 minutes after the test MIN is dialed. The classification of the MIN is determined either in real time or in post-processing, depending on the data packets received by the ISDN terminal adapter 1410. Once the MIN is classified, or after it is determined that classification should be performed in post-processing, the call to the MIN is disconnected. The disconnection may occur 20 seconds after the data packet is received (if the data packet contains voice information) or 5 seconds (if the data packet contains a fast busy tone). If the call processing continues for 2 minutes, the total seconds of the ringing tone may be used as an indication of whether the test MIN is assigned to the subscriber. For example, a telephone number that rings for 90 to 120 seconds and then becomes a fast busy tone is more likely to be assigned to a valid user.

Fig. 17 illustrates an exemplary method for analyzing data packets received on a bearer channel according to a third embodiment of the present invention. A data packet of the B channel is received by the computer and a Fast Fourier Transform (FFT) is performed on the received data packet to obtain frequency components (step 1705). The FFT is particularly useful for determining whether a received data packet contains busy tones, ringing tones, silence, or voice information. Using the FFT algorithm, the computer can dynamically determine the duration of call processing. If a 'connect' message is not received for a particular test MIN, the call processing is stored solely to obtain sufficient information so that the test MIN can be properly classified.

Using the FFT to determine silence, ringing tones, fast busy tones, and voice can allow calls that have produced enough voice or calls that do not produce voice, i.e., busy tones, to terminate early, thereby increasing the number of calls per minute. The FFT provides a dynamic, intelligent metric for the control computer to assist in gathering information that will be used to determine whether a test MIN is assigned. Thus, the FFT allows a determination of whether a telephone number is assigned based on the receipt of busy tones, ringing tones, and other types of signaling contained in the data packet.

Using the frequency components, a determination is made as to whether the data packet contains voice information (step 1710). If the packet does not contain voice information ("no" path out of decision step 1710), a determination is made as to whether more packets have been received for the test MIN (step 1715). If no more packets have been received ("no" path out of decision step 1715), the packets are analyzed in post-processing (step 1720). However, if more data packets are received ("yes" path out of decision step 1715), the system continues to analyze the received data packets to determine if they contain voice information (steps 1705 and 1710).

If it is determined that the data packet contains voice information ("yes" path out of decision step 1710), clipping(s) are loaded in a cross correlator running on the computer to perform pattern recognition (step 1725). The cross-correlation performed by passing clippings over voice information will be described in more detail below. If the cross-correlation does not result in a match ("no" path out of decision step 1730), a determination is made as to whether more packets have been received (step 1715) and the process continues. If, however, the cross-correlation results in a match ("yes" path out of decision step 1730), the MIN is marked as "assigned", "unassigned", or "retried" according to the meaning of the clippings (step 1735). The MIN marked "retry" is redialed at a later time. The MIN and the results of "assigned" or "unassigned" are stored in a database on the computer (step 1740) and the call is terminated (step 1745).

As discussed above, cross-correlation utilizes clipping for packet classification. Since the present invention uses a digital line to test the MIN, the received data packet is less distorted than information received over a conventional analog line, and the correlation of the received voice data is therefore more accurate. Fig. 18 illustrates an exemplary method for generating a clip according to the third embodiment of the present invention. To obtain a cut-off, a sample containing a certain ratio of the total number of test MINs is dialed and the result saved, for example, as a.wav file. Initially, the wav file is divided into voice and non-voice files (step 1805). The non-voice file is marked for redial (step 1810). One of the files containing the voice information is selected and used to make a clip (step 1815). The cut is a wav file that contains the least amount of information to classify a MIN. The cut-out can be performed using various different types of software, including music editing software such as Sonic Sound fountain, CoolEdit, and Nero Wave Editor.

Figure 19 illustrates several wav files, clips made from the wav files, and the meaning assigned to the clips. As shown in fig. 14, the wav file containing the sentence "the user called by you is not answered at this time" is parsed into a cut of "unanswered" in syntax. Thus, the clip "unanswered" is the minimum amount of information required to uniquely identify the wav file as being associated with the assigned MIN. In fig. 19, a single character highlighted in the wav file is used to generate a clip. Cut-offs are then associated with the meaning of "unassigned", "assigned", or "retry" (step 1820). The clip is then compared to all other records in the sample of test MINs (step 1825). If the clip matches a portion of the wav file for at least one of the other MINs in the sample, the clip is stored for use in the cross-correlation process described above in connection with figure 17 (step 1830). Step 1830 reduces the number of clips used for testing by eliminating clips to which meanings have been assigned. The MINs in the samples associated with the wav files that match the cut are sorted according to the meaning of the cut (step 1835).

The MIN associated with the wav file having the meaning of "retry" is flagged for redial (step 1840). The MIN associated with the wav file having the meaning of "assigned" or "unassigned" is stored in a database in the computer with the appropriate meaning (step 1845). Finally, it is determined whether there are more wav files in the sample (step 1850). If there are no more wav files in the sample ("no" path out of decision step 1850), the sampling process ends and the clip is loaded in the computer for comparison with the received packet. However, if the sample exists a.wav file in the sample for which no meaning has been determined ("yes" path out of decision step 1850), clipping is performed on the next.wav file in the sample according to steps 1815 and 1845.

After the MINs have been tested according to the techniques of the first, second or third embodiments described above, statistical data is generated using the test results. FIG. 20 illustrates a method for generating statistical data according to an exemplary embodiment of the present invention. As shown in fig. 20, three different statistics are generated using the tested MINs. Specifically, market share is calculated (step 2010), frequent customer service provider changes are calculated (step 2020), and total increase is calculated (step 2030). It will be appreciated that the order in which the statistics are calculated in fig. 20 is merely exemplary, and that the statistics may be calculated in virtually any order.

Figure 21A illustrates an exemplary table of data collected during the MIN testing process, and the calculation of market share in accordance with the present invention. The calculation of market share may be performed at the time the MIN test is performed or after the test has been completed. To determine market share, the number of MINs labeled "assigned" is divided by the sampling rate to estimate the total number of actual MINs within the specified NPA-NXX-X range. In the table shown in FIG. 21A, 325 test MINs out of 500 test MINs are determined to be assigned in the range NPA-NXX-X from 434-426-0 to 434-426-9. Thus, the total number of assigned MINs for the entire range is estimated to be 325 ÷ 0.05 ═ 6500. This process is repeated for all line ranges. In the table shown in fig. 21A, it is estimated that wireless service provider a has 13400 total users and that wireless service provider B has 17000 total users. If the wireless service providers in the market are only wireless service provider a and wireless service provider B, the total number of users in the market is 30400. Thus, the market share of wireless service provider a is 44.1% (i.e., 13400 ÷ 30400), while the market share of wireless service provider B is 55.9% (i.e., 17000 ÷ 30400).

Fig. 21B illustrates an exemplary table for storing an estimate of a user's frequent replacement of service providers. It will be appreciated that frequent subscriber changes of service providers is a measure of how many subscribers terminate the wireless service provided by a particular wireless service provider during a particular time interval. This time interval is typically one month or one quarter. With the data in the table of FIG. 21A, it is assumed that the data was collected on 1 month, 1 day with a list of specific test MINs. If the same list of test MINs is measured on month 1, 2, it may be known for each test MIN whether the MIN is assigned or unassigned on month 1, and whether the MIN is assigned or unassigned on month 1, 2. Thus, the number of test MINs assigned on day 1/month and determined to be unassigned on day 1/month is used to account for frequent replacement of service providers by the subscriber. The result of this comparison is divided by the sampling rate to estimate the frequent change of service provider for the total subscriber of each wireless service provider.

Using the data in the table shown in fig. 21B, wireless service provider a has 52 test MINs to change from "assigned" to "unassigned" between 1 month 1 and 2 months 1, while wireless service provider B has 49 test MINs to change from "assigned" to "unassigned" during the same time. Thus, the estimated subscriber frequent replacement service provider for the MIN of wireless service provider a is 1040 (i.e., 52 ÷ 0.05) and the estimated subscriber frequent replacement service provider for the MIN of wireless service provider B is 980(49 ÷ 0.05). The subscriber frequent replacement service provider rate is calculated by dividing the estimated subscriber frequent replacement service provider of MINs by the number of estimated MINs assigned by the particular line service provider. Thus, the user of wireless service provider a has a frequent service provider change rate of 7.76% (i.e., 1040 ÷ 13400) per month, while the user of wireless service provider B has a frequent service provider change rate of 5.76% (i.e., 980 ÷ 17000) per month. In addition, other user frequent replacement service provider statistics can also be calculated. For example, the user frequent change service provider rate formula may be modified to have a denominator representing the average user at the beginning of the measurement period and at the end of the measurement period. A user of the wireless service provider may also calculate a share of frequent changes of the service provider. For example, the user of wireless service provider a has a share of 51.49%, 1040 ÷ (1040+980), of frequent service provider changes.

Fig. 21C illustrates a table storing estimated total added number of users according to an exemplary embodiment of the present invention. The total subscriber increase is a measure of how many subscribers start wireless traffic during a particular time interval, which is typically a month or a quarter. Assume that the data listed in the table shown in figure 21A represents measurements of a particular list of test MINs on day 1/month. To determine the total increase, a modified set of test MINs was used for measurements at 2 months and 1 day. It should also be appreciated that the wireless service provider may add new line ranges to accommodate expansion after 1 month 1 day measurements but before 2 month 1 day measurements. The modified set of test MINs includes the test MIN for the 1 month, 1 day measurement plus the sample rate times the number of MINs in the new line range. For example, if wireless service provider a increased the NPA-NXX range of 434-429 by 1 month, then a modified test MIN of 2 months would include an additional 500 MINs, namely 10000 new MINs multiplied by 5% sample rate. Thus, the present invention can determine the number of test MINs that were unassigned on day 1/1 and assigned on day 1/2.

To calculate the estimated total increase MIN, the number of MINs that were unassigned on day 1 month 1 and assigned on day 1 month 2 is divided by the sample rate. Taking the data in the table shown in fig. 21C as an example, wireless service provider a and wireless service provider B have 73 and 57 unassigned test MINs at 1 month and 1 day and 2 months and 1 day, respectively. With a sampling rate of 5%, the total increase in MIN for wireless service provider a is estimated to be 1460 (i.e., 73 ÷ 0.05) and the total increase in BMIN for wireless service provider is estimated to be 1140 (i.e., 57 ÷ 0.05). In addition, other overall increase formulas may also be employed. For example, the total addition formula may be modified such that the denominator represents the average user at the beginning of the measurement period and at the end of the measurement period. The total subscriber increase share of the wireless service provider may also be calculated. For example, the user of wireless service provider a has a share of 56.15%, i.e., 1460 ÷ (1460+1140), of frequent service provider changes. To calculate the total increase percentage for each wireless service provider over a one month period, the estimated total increase MIN is divided by the number of estimated MINs for that wireless service provider at the starting time. Thus, the total percent increase for wireless service provider a is 10.90% (i.e., 1460 ÷ 13400) and for wireless service provider B is 6.70% (i.e., 1140 ÷ 17000).

Since the local routing number obtained using the local number portability DIP is used to identify which particular service provider a particular MDN/phone number is assigned to, this information can be used to generate more detailed market statistics. In particular, measurements of ported users can now be calculated. FIG. 22A illustrates a table containing data about ported users. The table in fig. 22A assumes that on day 1 month 1, 10000 telephone numbers were sampled and each sample was served by its local service provider, i.e., the local routing number field of the SS7DIP response message indicates no local routing number. The table in fig. 22A illustrates the results of performing local number portability database DIP for the same market on day 1/2. Fig. 22B illustrates the handover rate between service providers using the data in the table of fig. 22A. For both landline and wireless service providers, the information shown in fig. 22A and 22B is useful in determining who wins and who loses users in a particular market. The local number portability database DIP is very fast and inexpensive, so it is feasible to perform DIP for all phone numbers and all MDNs in the market. Errors will be eliminated because the entire market population can be sampled.

Since all MDNs in the market can be tested quickly and at low cost using the local number portability database, historical statistics can be calculated for users who frequently change service providers. In particular, after testing the MDN for a period of time, the number of times a particular MDN has been migrated over that period of time can be tracked. This information may be very useful to the service provider because it shows which users are more likely to continue using a certain service provider and which users are more likely to change the service provider. Of course, it is less attractive for a service provider to change users of a wireless service provider every month than to not change the service provider for two years. Likewise, all telephone numbers of the market, whether wireless or landline, can be tested in the same manner.

The invention has been described with reference to several exemplary embodiments. However, it will be readily apparent to those skilled in the art that the present invention may be embodied in specific forms other than those of the exemplary embodiments described above. This can be done without departing from the spirit of the invention. The exemplary embodiments are merely illustrative and should not be considered restrictive in any way. The scope of the invention is given by the appended claims, rather than the preceding description, and all variations and equivalents which fall within the range of the claims are intended to be embraced therein.

Claims (48)

1. A method for determining market statistics for first and second service providers, comprising:

testing a plurality of telephone numbers;

automatically interpreting a response to said test to determine whether at least one of said plurality of telephone numbers is assigned by one of said first and second service providers; and

market statistics are determined for the first and second service providers using the interpreted responses.

2. The method of claim 1,

the testing step comprises

Sending a message to a database associated with at least one of the plurality of telephone numbers, an

Wherein the response to the message is utilized to determine whether at least one telephone number is assigned by the first or second service provider.

3. The method of claim 2, wherein the message comprises a telephone number.

4. The method of claim 2, wherein the message is an authentication message that includes a telephone number and a sequence number, the sequence number in the authentication message not being associated with the telephone number.

5. The method of claim 2, wherein the database is included in a home location register.

6. The method of claim 5, wherein the message is sent to the home location register via a signaling system 7 network.

7. The method of claim 2, wherein the at least one telephone number is determined to be assigned to a user if the response indicates that the serial number is invalid or the serial number is not assigned.

8. The method of claim 1,

the testing step comprises

Dialing said plurality of telephone numbers through a digital connection, an

The automatically interpreting step includes

The response received over the digital connection is compared to a predetermined response.

9. The method of claim 8, wherein said response and said predetermined response are digital messages, said comparing being performed automatically.

10. The method of claim 9, wherein the automatic comparison is performed by employing pattern recognition.

11. The method of claim 8, wherein the predetermined response comprises a digital message, a voice announcement, and an in-band tone.

12. The method of claim 11, wherein the response is a 'connect' message indicating that a telephone number is assigned.

13. The method of claim 11, further comprising: fast fourier transforms are used to distinguish in-band tones from each other and from voice announcements.

14. The method of claim 11, wherein the comparing step employs pattern recognition to interpret voice announcements.

15. The method of claim 9, wherein the predetermined response contains a minimum amount of information to uniquely and automatically interpret the response.

16. The method of claim 8, wherein the step of comparing responses comprises:

performing a pattern recognition procedure on the response;

determining whether the response is a digital message or an in-band tone; and

only responses that are not determined to be digital messages or in-band tones are compared to the predetermined response.

17. The method of claim 2, wherein the database is a telephone number portability database.

18. The method of claim 17, wherein the determination of whether the telephone number is assigned is based on receipt of a message from a database that includes a local routing number.

19. The method of claim 18 wherein the local routing number is employed to determine which service provider is associated with the telephone number.

20. The method of claim 19, further comprising:

the number of times a telephone number has been ported between service providers is tracked.

21. The method of claim 1, wherein the user statistics comprise market shares for the first service provider and the second service provider, user frequent service provider changes shares, total user increase, and total user increase shares.

22. The method of claim 1, further comprising:

sending a message to a telephone number portability database;

receiving a response from the telephone number portability database; and

the response is automatically interpreted to determine which service provider service telephone number.

23. A method for determining market statistics for first and second service providers, comprising:

testing a plurality of telephone numbers by sending a message to a database associated with at least one of the telephone numbers;

automatically interpreting a response to the test by determining whether the at least one telephone number is not assigned by a service provider using a response to the message; and

market statistics are determined for the first and second service providers using the interpreted responses.

24. The method of claim 23, wherein the at least one telephone number is determined to be unassigned if the response indicates that the at least one telephone number is not recognized, or that the at least one telephone number is sent to an error database, or that the at least one telephone number is unassigned.

25. A system for determining market statistics for a first service provider and a second service provider, comprising:

means for testing a plurality of telephone numbers;

means for automatically interpreting a response to said test to determine whether at least one of said plurality of telephone numbers is assigned by one of said first and second service providers; and

means for determining market statistics for the first service provider and the second service provider using the interpreted responses.

26. The system of claim 25,

the device for testing comprises

Means for sending a message to a database associated with at least one of said plurality of telephone numbers, an

Wherein the response to the message is utilized to determine whether the at least one telephone number is assigned by the first or second service provider.

27. The system of claim 26, wherein said message comprises a telephone number.

28. The system of claim 26, wherein the message is an authentication message that includes a telephone number and a sequence number, the sequence number in the authentication message not being associated with the telephone number.

29. The system of claim 26, wherein said database is included in a home location register.

30. The system of claim 29, wherein the message is sent to the home location register via a signaling system 7 network.

31. The system of claim 26, wherein the at least one telephone number is determined to be assigned to a user if the response indicates that the serial number is invalid or the serial number is not assigned.

32. The system of claim 25,

the device for testing comprises

Means for dialing said plurality of telephone numbers through a digital connection, and

the device for automatic interpretation comprises

Means for comparing a response received over the digital connection with a predetermined response.

33. The system of claim 32, wherein the response and the predetermined response are digital messages and the comparison is performed automatically.

34. The system of claim 33, wherein the automatic comparison is performed by utilizing pattern recognition.

35. The system of claim 32, wherein the predetermined response comprises a digital message, a voice announcement, and an in-band tone.

36. The system of claim 35, wherein the response is a 'connect' message indicating that a telephone number is assigned.

37. The system of claim 35, further comprising: means for distinguishing in-band tones from each other and from voice announcements using fast fourier transforms.

38. The system of claim 35, wherein the comparing step applies pattern recognition to interpret voice announcements.

39. The system of claim 33, wherein the predetermined response contains a minimum amount of information to uniquely and automatically interpret the response.

40. The system of claim 32, wherein the means for comparing responses comprises:

means for performing a pattern recognition procedure on the response;

means for determining whether the response is a digital message or an in-band tone; and

means for comparing only responses that are not determined to be digital messages or in-band tones with the predetermined response.

41. The system of claim 26, wherein the database is a telephone number portability database.

42. The system of claim 41, wherein the determination of whether the telephone number is assigned is based on receipt of a message from a database that includes a local routing number.

43. The system of claim 42, wherein the local routing number is used to determine which service provider is associated with the telephone number.

44. The system of claim 43, further comprising:

means for tracking the number of times a telephone number has been ported between service providers.

45. The system of claim 25, wherein the user statistics include market shares for the first service provider and the second service provider, user frequent service provider changes shares, total user increase, and total user increase shares.

46. The system of claim 25, further comprising:

means for sending a message to a telephone number portability database;

means for receiving a response from the telephone number portability database; and

means for automatically interpreting the response to determine which service provider service telephone number.

47. A system for determining market statistics for first and second service providers, comprising:

means for testing a plurality of telephone numbers, including means for sending a message to a database associated with at least one of the plurality of telephone numbers;

means for automatically interpreting a response to the test, including means for utilizing the response to the message to determine whether the at least one telephone number is unassigned by a service provider; and

means for determining market statistics for the first and second service providers using the interpreted responses.

48. The system of claim 47, wherein the at least one telephone number is determined to be unassigned if the response indicates that the at least one telephone number is not recognized, or that the at least one telephone number is sent to an error database, or that at least one of the telephone numbers is unassigned.