CA2302399A1 - Apparatus and methods for automated testing of wireless communications systems - Google Patents
Apparatus and methods for automated testing of wireless communications systems Download PDFInfo
- Publication number
- CA2302399A1 CA2302399A1 CA002302399A CA2302399A CA2302399A1 CA 2302399 A1 CA2302399 A1 CA 2302399A1 CA 002302399 A CA002302399 A CA 002302399A CA 2302399 A CA2302399 A CA 2302399A CA 2302399 A1 CA2302399 A1 CA 2302399A1
- Authority
- CA
- Canada
- Prior art keywords
- testing
- service provider
- wireless
- responder
- wireless service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/06—Testing, supervising or monitoring using simulated traffic
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
Apparatus and methods are provided for testing a wireless service provider network through a virtual subscriber system. In one aspect of this invention, a method for testing a wireless service provider network generally comprises the steps of initiating outbound call attempts under control of a master to multiple automatic, mobile responders, receiving calls at at least some of the responders, monitoring parameters relating to the wireless service provider network and transmitting information indicative of those parameters to the master. Parameters testable through the system include audio quality testing, including 23-tone testing, quantitative testing of audio quality, RF power testing, frequency testing and spectrum analysis testing. In the preferred method, testing may be performed by multiple responder units displaced throughout the geography of the wireless service provider, so as to provide real time indication of the network quality. Preferably, a global positioning system is utilized to provide location information regarding a responder's position. In yet another aspect of this invention, a method for testing communication between two wireless communication devices is provided. A master initiates a call to a first responder including a first wireless communication device, the first wireless communication device initiates a call over the network to a second wireless communication device in a second responder, testing is performed, and the results of the testing are provided to the master via the network. Wireless communication devices and networks testable with these inventions include at least mobile phone systems and PCS systems.
Description
WO 99/12228 PC"T/US98/16763 DESCRIPTION
APPARATUS AND METHODS FOR AUTOMATED
TESTING OF WIRELESS COMMUNICATIONS SYSTEMS
Field of the Invention This invention relates to the field of automated test equipment. More particularly, it relates to automated test equipment for wireless communication systems, especially cellular communications systems and personal communications systems.
Background of the Invention Various wireless communication systems have been known in the art. Personal wireless communication systems are available in various forms and formats.
Currently, cellular telephone systems are a popular form of wireless personal communication systems.
Additionally, personal communication services (PCS) systems are now available.
Fig. 1 shows a diagramatic view of a typical wireless service provider network.
Broadly, the complete system includes the public switched telephone network 10, the wireless service provider network 20 and wireless subscriber users 30. The public switched network 2 0 10 serves in a conventional manner to provide switched communications among various callers. The wireless service provider network 20 generally comprises a distribution network, most typically including a radio frequency distribution network of cell sites 22. The cell sites 22 provide a wireless communication link to mobile communication devices or mobile phones 32. Mobile phones 32 are known by various terms, and come in various technologies, 2 5 examples of such terminology and technology include, but are not limited to, wireless cellular, flip phones, cellular phones, mobile telephones, cell phones and PCS phones.
Generally, within the wireless service provider network 20, one or more cell sites 22 are linked to a base station controller 24. In turn, one or more base station controllers 24 are linked to a mobile telephone switching center 26. The communication link I2 between the public switch 3 0 network 10 and the wireless service provider 20, as well as communication links 28 among the various components of the wireless service provider network 20, are typically digital land-based or microwave carrier systems. For example, T1, T3 or SONET facilities may be utilized.
The particular system architecture within a given wireless service provider network 20 currently tend to be manufacturer specific. Current manufacturers of such systems include Motorola, LM Ericsson, Nortel, Hughes Network Systems, Astronet and Lucent Technologies. Mobile phones 32 are available from many commercial sources.
Historically, mobile phones 32 were analog systems. More recently, mobile phones 32 include dual-mode mobile phones which support both analog and digital transmission systems. In addition to the providers of the wireless service network equipment, identified previously, current mobile phone manufacturers also include Oki, Samsung, Toshiba and NEC.
Cell sites 22 are geographically distributed throughout a region served by a given wireless service provider. As the cell site 22 has a limited geographic coverage area, wireless service providers have been required to determine service area coverage through various methods. Predictive models of coverage area have been utilized. Further, "drive tests" have been utilized in which a technician affiliated with the wireless service provider moves about the geography of the region covered by the wireless service provider.
Typically, a skilled field engineer drives a vehicle including sophisticated test equipment throughout the region believed to be covered by the wireless service provider. Commonly, the testing is initiated 2 0 by causing a call to be placed from the mobile test equipment to a land-based, receiving location. A communication path is thereby established between the mobile test equipment and the receiving station. The initiation of the call from the mobile test equipment is initiated by the technician. Tests typically performed include detailed radio frequency and system performance test data measuring radio frequency strength, frequency, noise, co-channel 2 5 interference as well as other relevant parameters. Usually, the test data is collected and archived within the mobile test vehicle. The test data collected by the mobile unit is then often times combined with data from multiple other mobile units upon their return to the land-based facility.
Such "drive tests" utilizing dedicated testing vehicles is subject to a number of 3 0. disadvantages. First, the testing for the entire wireless service provider network is not made in real time, as the test data resides in multiple vehicles, not at a central site. Second, the costs associated with such dedicated vehicles is very high. A fully equipped vehicle used in a drive test often costs from $100,000 to $250,000. Further, a skilled field engineer is required to operate the equipment and conduct the tests. Generally, multiple tasks must be performed in operating such systems, for example, the field engineer often collects the data, whereas then that data must be entered by yet another person for processing, and later for display. Yet further intervention is required for modifications or upgrading of the equipment such as for upgrading software through revisions, bug-fixes or feature additions.
Yet another type of testing performed on wireless service provider networks are cell simulation. The term call simulator has many synonyms, including, but not limited to, load tester, load box, line simulator and bulk call generator. All of these terms generally relate to devices which serve to simulate calls. Typically, a call simulator serves to automatically generate outbound calls through the wireless service provider network to various intended called parties. Typically, the called parties are individuals having a mobile phone. Various information regarding the placement of calls, such as number of attempts and call completion percentages, may be generated at the load box end of the system. Typically, the called parties may be requested to manually record various data regarding the call, such as location of the received call and some subjective assessment of the call quality.
Test equipment has been utilized in which a dedicated phone testing unit is placed in a vehicle. The unit is adapted to work with a specific manufacturer's phone.
Calls may be 2 o placed from and received by the dedicated phone, with network parameters under test including network coverage, quality, and identification of location of existing problems. A
GPS capability is provided to provide location information. The parameter information is stored to a PCMCIA flash disk. This data may be transferred by a technician after storage for collection and analysis by the system.
In yet another system, a ruggedized personal computer is placed in a mobile vehicle for wireless network provider testing. The system utilizes actual speech samples to monitor the system quantitatively utilizing a mean opinion scoring measurement. The mobile test unit consists of an embedded PC, audioprocessing hardware, GPS receiver and one or more cellular transceivers. The mobile test unit automatically places and receives calls to and from 3 o the field test unit while being driven over a selected or random route.
Wireless service providers have long sought methods for conducting coverage tests which provide usable system quality and performance data without the requirement for such time intensive and costly field engineer drive tests, and to make audio quality tests using traditional test methods without the need to depend on subjective Mean Opinion Score quality rating measurements. This invention is directed towards a solution of these long standing concerns.
Summary of the Invention Apparatus and methods for automated testing of wireless communications systems is provided. In one aspect of the inventive method, testing of the wireless service provider network generally comprises the steps of, first, initiating one or more outbound call attempts under control of a master to one or more automatic mobile responders, second, receiving calls from at least some of the automatic, mobile responders, third, monitoring parameters relating to the wireless service provider network and fourth, transmitting information between the responder and master indicative of the parameters. Testing of the wireless service provider may be in any form or parameter, and especially includes quantitative testing of the wireless service provider network. Other parametric testing optionally includes radio frequency power level testing, frequency testing, audio quality testing, especially through the use of the 23-tone test, and spectrum analysis. Optionally, the testing method further includes the step of analyzing the information transmitted, preferably from multiple responders to the master. In 2 0 this way, information may be obtained from multiple automatic mobile responders located throughout the geography covered by the wireless service provider network, thereby providing real-time assessment of the network.
The system level invention comprises a system for testing a wireless network which generally comprises an analysis system coupled to a master, where the master serves to 2 5 automatically place calls, and optionally to receive calls, when connected to a wireless network or public switched network. The system includes one or more responders adapted to automatically communicate through the wireless service provider network with the master.
The responders are provided with an antenna connection for communication with the wireless service provider RF (radio frequency) network and include a receptacle adapted to receive one 3 0 or more wireless communication device. In accordance with one aspect of this invention, one or more standard mobile phones of any manufacturer may be utilized to emulate regular wireless subscriber calls. The mobile phones used in the responder architecture may alternatively be VLSI-chip-level mobile phones, test phone or any combination thereof. A
responder control system typically includes a wireless control device controller, parametric testing systems and digital signal processing capability. Preferably, the system is equipped 5 with a global positioning system which provides some or all of the position, time and velocity of the responder unit.
In yet another aspect of this invention, apparatus and method are provided for testing communications between a first wireless communication device and a second wireless communication device over a wireless service provider network. Generally, the apparatus and steps comprise utilizing a master to initiate a call to a first responder including a first wireless communication device, wherein the first responder is instructed to effectuate a subsequent call to the second wireless communication device in the second responder. Once the call is placed between the first wireless communication device and second wireless communication device, testing is performed. At least one of the first and second responders communicates with the master to provide test data regarding the call between the first wireless communication device and the second wireless communication device.
In one aspect of this invention, a testing system is provided whereby "virtual subscribers" are provided by automated, mobile responder units. In the preferred embodiment, the responders are of sufficiently small size so as to readily fit within a typical 2 o automobile trunk, and are more particularly preferred to be substantially smaller than the volume of the trunk, preferably less than one cubic foot. In this way, the responders may be placed in vehicles which are not dedicated to the testing function, but have a independent purpose. For example, responders may be included in vehicles that cover regular, thorough routes, such as postal or public transit vehicles, or in vehicles which cover relatively regular 2 5 routes with some degree of variation, such as delivery vehicles, or in vehicles which cover random routes, and may go into and out of the service area, such as taxis, or vehicles owned by the wireless service provider. While the responders typically would be located within a mobile vehicle, at least certain of the responders within a system may be immobile without varying from the invention described herein.
3 0 In yet another aspect of this invention, the system may be utilized to emulate any feature or function of the wireless service provider and to test implementation of that feature.
APPARATUS AND METHODS FOR AUTOMATED
TESTING OF WIRELESS COMMUNICATIONS SYSTEMS
Field of the Invention This invention relates to the field of automated test equipment. More particularly, it relates to automated test equipment for wireless communication systems, especially cellular communications systems and personal communications systems.
Background of the Invention Various wireless communication systems have been known in the art. Personal wireless communication systems are available in various forms and formats.
Currently, cellular telephone systems are a popular form of wireless personal communication systems.
Additionally, personal communication services (PCS) systems are now available.
Fig. 1 shows a diagramatic view of a typical wireless service provider network.
Broadly, the complete system includes the public switched telephone network 10, the wireless service provider network 20 and wireless subscriber users 30. The public switched network 2 0 10 serves in a conventional manner to provide switched communications among various callers. The wireless service provider network 20 generally comprises a distribution network, most typically including a radio frequency distribution network of cell sites 22. The cell sites 22 provide a wireless communication link to mobile communication devices or mobile phones 32. Mobile phones 32 are known by various terms, and come in various technologies, 2 5 examples of such terminology and technology include, but are not limited to, wireless cellular, flip phones, cellular phones, mobile telephones, cell phones and PCS phones.
Generally, within the wireless service provider network 20, one or more cell sites 22 are linked to a base station controller 24. In turn, one or more base station controllers 24 are linked to a mobile telephone switching center 26. The communication link I2 between the public switch 3 0 network 10 and the wireless service provider 20, as well as communication links 28 among the various components of the wireless service provider network 20, are typically digital land-based or microwave carrier systems. For example, T1, T3 or SONET facilities may be utilized.
The particular system architecture within a given wireless service provider network 20 currently tend to be manufacturer specific. Current manufacturers of such systems include Motorola, LM Ericsson, Nortel, Hughes Network Systems, Astronet and Lucent Technologies. Mobile phones 32 are available from many commercial sources.
Historically, mobile phones 32 were analog systems. More recently, mobile phones 32 include dual-mode mobile phones which support both analog and digital transmission systems. In addition to the providers of the wireless service network equipment, identified previously, current mobile phone manufacturers also include Oki, Samsung, Toshiba and NEC.
Cell sites 22 are geographically distributed throughout a region served by a given wireless service provider. As the cell site 22 has a limited geographic coverage area, wireless service providers have been required to determine service area coverage through various methods. Predictive models of coverage area have been utilized. Further, "drive tests" have been utilized in which a technician affiliated with the wireless service provider moves about the geography of the region covered by the wireless service provider.
Typically, a skilled field engineer drives a vehicle including sophisticated test equipment throughout the region believed to be covered by the wireless service provider. Commonly, the testing is initiated 2 0 by causing a call to be placed from the mobile test equipment to a land-based, receiving location. A communication path is thereby established between the mobile test equipment and the receiving station. The initiation of the call from the mobile test equipment is initiated by the technician. Tests typically performed include detailed radio frequency and system performance test data measuring radio frequency strength, frequency, noise, co-channel 2 5 interference as well as other relevant parameters. Usually, the test data is collected and archived within the mobile test vehicle. The test data collected by the mobile unit is then often times combined with data from multiple other mobile units upon their return to the land-based facility.
Such "drive tests" utilizing dedicated testing vehicles is subject to a number of 3 0. disadvantages. First, the testing for the entire wireless service provider network is not made in real time, as the test data resides in multiple vehicles, not at a central site. Second, the costs associated with such dedicated vehicles is very high. A fully equipped vehicle used in a drive test often costs from $100,000 to $250,000. Further, a skilled field engineer is required to operate the equipment and conduct the tests. Generally, multiple tasks must be performed in operating such systems, for example, the field engineer often collects the data, whereas then that data must be entered by yet another person for processing, and later for display. Yet further intervention is required for modifications or upgrading of the equipment such as for upgrading software through revisions, bug-fixes or feature additions.
Yet another type of testing performed on wireless service provider networks are cell simulation. The term call simulator has many synonyms, including, but not limited to, load tester, load box, line simulator and bulk call generator. All of these terms generally relate to devices which serve to simulate calls. Typically, a call simulator serves to automatically generate outbound calls through the wireless service provider network to various intended called parties. Typically, the called parties are individuals having a mobile phone. Various information regarding the placement of calls, such as number of attempts and call completion percentages, may be generated at the load box end of the system. Typically, the called parties may be requested to manually record various data regarding the call, such as location of the received call and some subjective assessment of the call quality.
Test equipment has been utilized in which a dedicated phone testing unit is placed in a vehicle. The unit is adapted to work with a specific manufacturer's phone.
Calls may be 2 o placed from and received by the dedicated phone, with network parameters under test including network coverage, quality, and identification of location of existing problems. A
GPS capability is provided to provide location information. The parameter information is stored to a PCMCIA flash disk. This data may be transferred by a technician after storage for collection and analysis by the system.
In yet another system, a ruggedized personal computer is placed in a mobile vehicle for wireless network provider testing. The system utilizes actual speech samples to monitor the system quantitatively utilizing a mean opinion scoring measurement. The mobile test unit consists of an embedded PC, audioprocessing hardware, GPS receiver and one or more cellular transceivers. The mobile test unit automatically places and receives calls to and from 3 o the field test unit while being driven over a selected or random route.
Wireless service providers have long sought methods for conducting coverage tests which provide usable system quality and performance data without the requirement for such time intensive and costly field engineer drive tests, and to make audio quality tests using traditional test methods without the need to depend on subjective Mean Opinion Score quality rating measurements. This invention is directed towards a solution of these long standing concerns.
Summary of the Invention Apparatus and methods for automated testing of wireless communications systems is provided. In one aspect of the inventive method, testing of the wireless service provider network generally comprises the steps of, first, initiating one or more outbound call attempts under control of a master to one or more automatic mobile responders, second, receiving calls from at least some of the automatic, mobile responders, third, monitoring parameters relating to the wireless service provider network and fourth, transmitting information between the responder and master indicative of the parameters. Testing of the wireless service provider may be in any form or parameter, and especially includes quantitative testing of the wireless service provider network. Other parametric testing optionally includes radio frequency power level testing, frequency testing, audio quality testing, especially through the use of the 23-tone test, and spectrum analysis. Optionally, the testing method further includes the step of analyzing the information transmitted, preferably from multiple responders to the master. In 2 0 this way, information may be obtained from multiple automatic mobile responders located throughout the geography covered by the wireless service provider network, thereby providing real-time assessment of the network.
The system level invention comprises a system for testing a wireless network which generally comprises an analysis system coupled to a master, where the master serves to 2 5 automatically place calls, and optionally to receive calls, when connected to a wireless network or public switched network. The system includes one or more responders adapted to automatically communicate through the wireless service provider network with the master.
The responders are provided with an antenna connection for communication with the wireless service provider RF (radio frequency) network and include a receptacle adapted to receive one 3 0 or more wireless communication device. In accordance with one aspect of this invention, one or more standard mobile phones of any manufacturer may be utilized to emulate regular wireless subscriber calls. The mobile phones used in the responder architecture may alternatively be VLSI-chip-level mobile phones, test phone or any combination thereof. A
responder control system typically includes a wireless control device controller, parametric testing systems and digital signal processing capability. Preferably, the system is equipped 5 with a global positioning system which provides some or all of the position, time and velocity of the responder unit.
In yet another aspect of this invention, apparatus and method are provided for testing communications between a first wireless communication device and a second wireless communication device over a wireless service provider network. Generally, the apparatus and steps comprise utilizing a master to initiate a call to a first responder including a first wireless communication device, wherein the first responder is instructed to effectuate a subsequent call to the second wireless communication device in the second responder. Once the call is placed between the first wireless communication device and second wireless communication device, testing is performed. At least one of the first and second responders communicates with the master to provide test data regarding the call between the first wireless communication device and the second wireless communication device.
In one aspect of this invention, a testing system is provided whereby "virtual subscribers" are provided by automated, mobile responder units. In the preferred embodiment, the responders are of sufficiently small size so as to readily fit within a typical 2 o automobile trunk, and are more particularly preferred to be substantially smaller than the volume of the trunk, preferably less than one cubic foot. In this way, the responders may be placed in vehicles which are not dedicated to the testing function, but have a independent purpose. For example, responders may be included in vehicles that cover regular, thorough routes, such as postal or public transit vehicles, or in vehicles which cover relatively regular 2 5 routes with some degree of variation, such as delivery vehicles, or in vehicles which cover random routes, and may go into and out of the service area, such as taxis, or vehicles owned by the wireless service provider. While the responders typically would be located within a mobile vehicle, at least certain of the responders within a system may be immobile without varying from the invention described herein.
3 0 In yet another aspect of this invention, the system may be utilized to emulate any feature or function of the wireless service provider and to test implementation of that feature.
By way of example, certain systems permit a mobile telephone number to be changed to another area code. Certain models permit mobile phones telephone numbers to be changed remotely. The system of this invention would permit the changing of the telephone number of the mobile phone, when permitted, either locally at the responder or remotely, to permit testing of this feature. In this way, accuracy of roaming and number verification systems can be achieved. This particular test would serve to verify the home location register (HLR) used by wireless service providers. Yet other features of such a test system would permit testing of an authentication system center (AUC) which manages the security data for subscriber authentication. Similarly, the equipment identify register (EIR) which stores the data of mobile equipment (ME) or ME-related data.
Accordingly, it is an object of this invention to provide an improved apparatus and method for providing usable system quality and performance data.
It is yet another object of this invention to provide an apparatus and system which provides information regarding a wireless network without requiring drive tests by skilled field engineers.
It is yet a further object of this invention to provide a system which serves to improve the quality and reliability of wireless communications systems.
Brief Description of the Drawings 2 0 Fig. 1 shows a diagrammatic view of a wireless service provider network.
Fig. 2 shows a diagrammatic view of the subscriber wireless automated remote measurement system.
Fig. 3 shows a block diagram description of the analysis software components for the subscriber wireless automated remote measurement system.
2 5 Fig. 4 shows a perspective view of the responder equipment.
Fig. 5 shows a block diagram view of the main hardware components of the responder system.
Fig. 6 shows a flowchart for the responder program flow.
Fig. 7 shows a flowchart for the inside weight for command sequence.
3 0 Fig. 8 shows a flowchart for the received call-back instructions sequence.
Fig. 9 shows a flowchart for a send-current location/time sequence.
Accordingly, it is an object of this invention to provide an improved apparatus and method for providing usable system quality and performance data.
It is yet another object of this invention to provide an apparatus and system which provides information regarding a wireless network without requiring drive tests by skilled field engineers.
It is yet a further object of this invention to provide a system which serves to improve the quality and reliability of wireless communications systems.
Brief Description of the Drawings 2 0 Fig. 1 shows a diagrammatic view of a wireless service provider network.
Fig. 2 shows a diagrammatic view of the subscriber wireless automated remote measurement system.
Fig. 3 shows a block diagram description of the analysis software components for the subscriber wireless automated remote measurement system.
2 5 Fig. 4 shows a perspective view of the responder equipment.
Fig. 5 shows a block diagram view of the main hardware components of the responder system.
Fig. 6 shows a flowchart for the responder program flow.
Fig. 7 shows a flowchart for the inside weight for command sequence.
3 0 Fig. 8 shows a flowchart for the received call-back instructions sequence.
Fig. 9 shows a flowchart for a send-current location/time sequence.
Fig. 10 shows a flowchart for the send oldest unsent unsuccessful call destails sequence.
Fig. 11 shows a flowchart for the 23-tone test receiving and scoring sequence.
Fig. 12 shows a flowchart for a network access test.
Fig. 13 shows a flowchart for an audio quality test.
Fig. 14 shows a flowchart for an unsuccessful completion test.
Fig. 15 shows a flowchart for a dropped call test.
Detailed Description of the Invention l0 Fig. 2 shows a diagrammatic view of primary elements of the subscriber wireless automated remote measuring system in one aspect of this invention. A call simulator 40 serves to initiate telephone calls. Preferably, the call simulator 40 emulates telephone calls placed over lines 56 through the public switched telephone network 10 and the wireless service provider network 20 to a responder 42 via the cell site 22. The call simulator 40 preferably includes the ability to receive calls originated from the responder 42. Call simulators are available from many commercial sources including Ameritec Corporation (FeatureCallTM system), Zarak Systems, Inc. (Abacus: Advanced Bulk Call Simulator), Teradyne (Hammer product line), and Redcom (TeleTraffic Generator).
The responder 42 serves to generate and/or receive calls. Further, it preferably 2 o performs parametric measurements of test calls and network status over the wireless network through one or more cellular telephone interfaces. The responder typically would include one or more wireless communication device 48, such as a mobile phone or PCS
device.
In the preferred embodiment of the subscriber wireless automated remote measuring 2 5 system, the responder 42 is capable of providing geographic position information. Most preferably, the responder 42 provides geographic position information through use of the global positioning system. In such a global positioning system, a satellite 52 provides positional information to the responder 42 as received by antenna 54. The responder 42 preferably provides the positional information via antenna 50 during a telephonic 3 o communication between the responder 42 and the line simulator 40 and analyzer 44.
In operation, the responder 42 may be deployed to various geographic locations.
Fig. 11 shows a flowchart for the 23-tone test receiving and scoring sequence.
Fig. 12 shows a flowchart for a network access test.
Fig. 13 shows a flowchart for an audio quality test.
Fig. 14 shows a flowchart for an unsuccessful completion test.
Fig. 15 shows a flowchart for a dropped call test.
Detailed Description of the Invention l0 Fig. 2 shows a diagrammatic view of primary elements of the subscriber wireless automated remote measuring system in one aspect of this invention. A call simulator 40 serves to initiate telephone calls. Preferably, the call simulator 40 emulates telephone calls placed over lines 56 through the public switched telephone network 10 and the wireless service provider network 20 to a responder 42 via the cell site 22. The call simulator 40 preferably includes the ability to receive calls originated from the responder 42. Call simulators are available from many commercial sources including Ameritec Corporation (FeatureCallTM system), Zarak Systems, Inc. (Abacus: Advanced Bulk Call Simulator), Teradyne (Hammer product line), and Redcom (TeleTraffic Generator).
The responder 42 serves to generate and/or receive calls. Further, it preferably 2 o performs parametric measurements of test calls and network status over the wireless network through one or more cellular telephone interfaces. The responder typically would include one or more wireless communication device 48, such as a mobile phone or PCS
device.
In the preferred embodiment of the subscriber wireless automated remote measuring 2 5 system, the responder 42 is capable of providing geographic position information. Most preferably, the responder 42 provides geographic position information through use of the global positioning system. In such a global positioning system, a satellite 52 provides positional information to the responder 42 as received by antenna 54. The responder 42 preferably provides the positional information via antenna 50 during a telephonic 3 o communication between the responder 42 and the line simulator 40 and analyzer 44.
In operation, the responder 42 may be deployed to various geographic locations.
8 PCT/US98/t6763 In the preferred mode, the responder 42 would be included within a vehicle so as to travel through the service area. Automated coverage testing may be achieved through the use of such mobile responder units. In the preferred embodiment, the responder units 42 operate remotely under control of the master 40. Most preferably, numerous responders 42 are provided in separate vehicles or locations throughout the service area, preferably in separate vehicles, so as to provide data to the master 40 and analyzer 44 under remote control from the master 40.
In one main intended application, this test methodology and equipment enables the wireless service provider the ability to validate service area predictive model data and to provide a survey of the quality of service and network status throughout a designated service area utilizing the wireless service providers subscriber's mobile phones.
While the system may be utilized to test for any telephony related problem consistent with the goals and objects of this invention, the main types of problems contemplated are as follows. First, unsuccessful network access may be monitored. Such an unsuccessful network access is an uplink problem wherein the wireless subscriber is unable to originate calls from a mobile phone. Secondly, the system may check for audio quality. Typically, simulation of voice conversation is performed over a wireless connection and measured from the wireless subscribers location. Both downlink call simulation and uplink call simulation may be tested. Third, unsuccessful call completion may be monitored. An unsuccessful call is 2 o defined as any call, either uplink and/or downlink, not completed as dialed. Fourth, dropped calls may be monitored. This generally is defined as any call terminated before a call termination command is initiated by either the calling or called party.
Ger~ally, the responder 42 is preferably located within a vehicle, most preferably a vehicle which moves through a relatively large geographic area within the wireless service provider region. Examples of vehicles preferably utilized with the methods of the system include:
postal or public transit vehicles (such as those that cover regular, thorough routes), delivery vehicles (such as those that cover regular routes which vary somewhat), taxis or other wireless service provider vehicles (such as those which cover random routes and sometimes go into and out of the service area}. Alternatively, the responder 42 may be placed at a 3 0 fixed location.
Fig. 3 shows a flowchart for the subscriber wireless automated remote measurement system analysis methods. The master 60 bi-directionally interfaces with a graphical user interface system 62, such as the FeatureCallT'~' system. The master 60 accesses the test processor 64. The test processor 64 in turn interacts with the database 66.
The database 66 bi-directionally accesses a configuration screen and data manager 68 various reports 70, standard and custom, may be prepared. Generally, the subscriber wireless automated remote measuring system analysis consists of the test processor 64, database 66, configuration screen and data manager 68 and report generator 70.
The database 66 must be of sufficient capacity, speed and sophistication to achieve the goals and objectives of this invention. Generally, a relational database management 1 o system (RDBMS) is utilized. In the preferred embodiment, the database 66 is Oracle Work Group for Windows NT. Among its various functions, the database 66 serves as a repository for test results and preferably contains configuration information.
The test processor 64, among other tasks, receives messages from the master 60 and translates them into SQL for the oracle database. Preferably, the test processor 64 is able to connect to multiple masters 60. Optionally, feedback may be provided from the test processor 64 to the master 60. The report package 70 preferably includes a graphical user interface (GUI) application to display test results and print reports. Derived values, e.g., signal to noise ratio, may be calculated by the report package 70. The configuration screens and data manager package 68 preferably serves to save data captured by the system for future 2 0 analysis. Generally, system 68 is a file management system for augmentation of the database 66. Optionally, the system 68 may be incorporated into the report package 70.
Optionally, a geological information system for GIS may be utilized in conjunction with the system disclosed herein. Typically, a geological information system provides through mapping software a system in which previously compiled geographic data may be 2 5 combined with newly collected and/or processed information to provide a composite image.
Such software is available from many sources, including ESRI (Environmental Systems Research Institute, Inc.), who offer programs including, but not limited to, ArcView, MapObjects, and ARC/INFO. Overlays may be utilized on the underlying data, such as location of cell sites, commercially existing map grids (e.g., Thomas Brother map grids) 3 0 or other relevant points of interest, either geographical or man-made.
The analysis components identified in Fig. 3 may be run on a single Windows NT
workstation .or notebook, or any other system which is compatible with the objects of this invention, such as Unix platforms, whether in a single work station or client-server configuration. Utilizing current technology, the system requirements would include: a single Pentium or PentiumPro processor running at or above 133 MHZ, 1.5 Gb available 5 disk space, 48 Mb of RAM, a CD-ROM, 10 base-T network card, and Windows NT
3.51 SPx or Windows NT 4.0 SPx.
Fig. 4 shows an exploded, perspective view of the responder 80 in one physical implementation. Overall, the responder 80 may be relatively compact, such as to fit within a standard vehicle trunk, and is most preferably relatively compact, in the preferred 1 o embodiment being 8 inches x 11 inches x 2.5 inches, or smaller. A base 82 is connected to a lid 84 such as by operation of a key lock system 88 which cooperatively secures the lid 84, base 82 and bracket 86. Preferably, the lid 84 is locked to the base 82 via a lock assembly 88. The bracket 86 preferably includes flanges 90 disposed on the bottom of the base to permit mounting of the responder 80, such as on the floor of a vehicle trunk.
Optionally, a bracket may be utilized to facilitate vehicle trunk or side-wall installations.
The interior of the responder 80 is preferably divided into two major components, the components being divided by a shield 92 so as to form a first compartment 94 and a second compartment 96. The first compartment 94 may contain, preferably, one or more 2 0 mobile phones 48, and may be alternatively designated as the mobile phone compartment 94. The second compartment 96 may contain responder electronics and be alternatively designated as the responder electronics compartment 96. One or more printed circuit boards 98 may be supported from the base 82 via standoffs 100. The printed circuit boards 98 may include the circuitry for the responder and, optionally, the global positioning satellite daughter board standoffs.
In yet another aspect of this invention, the combination of a standard subscriber mobile phone and a component or chip-level mobile phone may be utilized on-line simultaneously on two separate cellular or PCS calls. The results of these two separate calls may be coordinated and correlated by the analysis system.
3 0 The first compartment 94, when adapted for holding the mobile phone, preferably includes foam rubber material on both the base 82 and the lid 84. This foam rubber material serves to receive the mobile phone 48 within a nest so as to support the mobile phone 48 during vehicle motion. Optionally, a mobile phone window 102 is provided in the lid 84 to permit user observation of the mobile phone 48 panel.
The second compartment 96 is connected to the first compartment 94 by a connector 104 passing through shield 92. The mobile phone connector 106 meets with connector 104 and connects to the mobile phone 48. The mobile phone connector 106 is typically unique depending upon the type of mobile phone 48 utilized. The software utilized by the responders cellular telephone controller serves to configure the system for the specific brand of mobile telephone then utilized within the responder 80.
1 o The responder 80 includes various connections to external. An antenna connection 108 and global positioning satellite antenna connector 110 are provided. A
barrier strip 112 or water tight connector preferably provides for connection to ground 114, battery 116 and vehicle ignition 118. Preferably, provision is made to reduce risk of electrical error from electrostatic discharge through use of O-rings or elastomeric gaskets for sealing.
Fig. 5 shows an electrical block diagram of the responder electronics. A
microprocessor 110, such as Zilog microprocessor, is coupled to an address bus 112, databus 114 and control signal lines 116. A power supply 118 provides power to the system, and preferably comprises the vehicle battery. A regulator/sensor 120 provides a low battery voltage flag signal to the microprocessor 110 via the address but 112. The 2 0 regulator 120 optionally couples to a mobile phone variable voltage regulator 122, which in turn is connected to the mobile phone input/output port 124. The mobile phone input/output port 124 is preferably coupled to an analog to digital codec 126 providing phone/audio input/output. The A/D codec 126 is coupled to buses, such as address bus 112 and databus I14. Preferably, the A/D codec 126 is coupled to a digital signal processing chip 128, such as a 2171 DSP chip. The mobile phone input/output port 124 is further connected for mobile phone data and control signal communication to the mobile phone controller 130. The mobile telephone 130 is coupled to the buses, such as the address bus 112 and databus 114. External computer input/output 132 is likewise coupled to the buses.
Various control signals 134 are provided to various electronics. Chip select is 3 o effected via coupling between the address bus 112 and the control signal interface 134.
Optionally, an electronically programmable logic device (EPLD) 136 connects the chip select and control signal interface 134.
Optionally, a global positioning satellite system is utilized. A GPS daughter board 136 is coupled to the database 114. An antenna 138 connects to the daughter board 136.
Fig. 6 is a software flowchart for the responder program flow. At start-up 140, cold start begins when the power rises above 11.4 volts in a nominally 12 volt system.
Initialization 142 includes some or all of the following: global reset, start z-180 program, initialize digital signal processor and mobile telephone controller (CTC) initialize mobile phone, set call-back count to 0 and set call sequence number to 0. At "phone on" decision block 144, if the phone is not on, decision block 146 waits until the phone is turned on manually. If the phone is on, the call-back count block 148 is checked for count equals zero. If the count does not equal zero, then a call is placed to the master 150, which if not successful, block 158, is logged in the circular queue 160. A recheck is then made of the call-back count equally zero 148. If the call-back count is zero in decision block 148, the system waits for a call at block 162, receives the call at block 164, and performs a command at block 166. When completed, the system hangs up at step 168.
Fig. 7 is a flowchart for the inside wait for command program flow. After initiation at the wait for command block 170, the sequence checks the vehicle power status 172 after which the "phone off hook" decision block 174 is reached. If the phone is off hook at 2 o block 174, the hang up mobile phone block 176 is executed and a return 178 is made to the wait for command block 170. If the phone is not off hook as determined in decision block 174, decision block 182 queries whether valid DTMF command has been received at block 180. If valid DTMF commands have been received at decision block 180, various commands may be directed, including one or more of the following: receive call back 2 5 instructions 182, send current location and/or time 184, send oldest unsent unsuccessful call details 186, and receive and score 23-tone test 188. If no valid DTMF are received at block 180, the program flows into block 172. In an alternative implementation, rather than utilizing DTMF tones for communication, a modem may be utilized. Whether transmitted via DTMF or modem, it is preferred that an error checking procedure be utilized with the 3 o data transmission.
Fig. 8 shows a flowchart for the receive call back instructions sequence. The master (e.g., master 40 in Fig. 2 or 60 in Fig. 3) establishes the call 190 to the responder (e.g., 42 in Fig. 2) and transmits a prompting command and parameters at block 192 after which the master proceeds to the done with command block 194. The responder initially is in the wait for command state 196. During the transmit command " 11 " and parameters state 192, the responder is in a corresponding receive command " 11 " and parameters state 198. After receipt of the command and parameters, the call back number and call back counts are saved at block 200. The responder then returns to the wait for command state 196.
Fig. 9 shows the flowchart for the send current location/time sequence. The master begins with the established call block 210. The system then transmits command " 12" 212 to the responder. The responder begins in a wait for command state 214. After the transmit a prompting command step 212, the responder receives the prompting command in block 216. While the master is in the wait for reply state 218, the responder composes the result in state 220 and sends the result in state 222 to the master where it receives the result in state 224. After sending the result, the responder returns to the wait for command state 214. After the master receives the result in step 224, it sends the result to the test processor in block 226 after which the program is placed in a done with command state 228.
Fig. 10 shows a flowchart for the send oldest unsent unsuccessful call details program flow. The master begins with the establish call block 230. The master then 2 o transmits a prompting command at block 232 to the responder, which initially in the wait for command state 234 and then receives the prompting command in state 236.
While the master is in a wait for reply state 238, the responder finds the data in the circular queue state 240, and sends the result at block 242 to the master who receives the result at block 244. The master then sends the result to the test processor at step 246, after which the 2 5 master is done with the command at block 248.
Fig. 11 is a flowchart for the 23-tone test receiving and scoring sequence.
The 23-tone test is described in one or more of the following United States Patents No. 4,301,536, 4,417,337 and 4,768,203, incorporated herein by reference. The master establishes the call at block 250, acquires digital signal processing (DSP) resource at block 252 and transmits 3 o a prompting command at block 56 to the responder. The responder begins in a wait state 256, and receives the command from state 254 at the responder side in state 258. While the master waits. a period of time, e.g., 500 milliseconds at block 260, the responder during that wait interval 260 prepares a DSP to receive the 23-tone sequence at block 262.
The master sends the tones at step 264 and the receiver receives the tones at step 266.
Alternatively, or in combination, the responder may be commanded to transmit the 23-tone test to the master for analysis of the uplink path audio quality. The responder then processes bins and prepares results at step 268, selxiing the result at step 270 to the master which receives them at step 272. The responder then proceeds to a wait for command state 256. Upon receipt of results of step 272, the master sends the results to the test processor at step 274 after which it is placed in a done with command state 276.
Fig. 12 shows a flowchart for the network access test. After start block 280, a call is placed to the mobile phone at step 282 after which call back instructions are sent at step 284. The system then hangs up and waits for a call at step 286, and is optionally subject to a time out 288. If the call is placed, the call is then accepted at step 290, where upon a request for the current location is made at step 292. A request for the oldest unsent unsuccessful call details step 294 is made. At decision block 296, if the system has not received all unsent data, the system loops to yet again request the oldest unsent unsuccessful call detail step 294. If all unsent data has been received as determined at decision block 296, decision block 298 determines whether more call attempts are necessary.
If not, the program flows to a done state 300, whereas if more call attempts are required the program 2 o flows to the hang up and wait for call state 286.
Fig. 13 shows a flowchart for an audio quality test. From start block 310, a call is placed to the mobile phone at step 312, upon which a request is made for the current location in step 314 as determined by the responder. Thereafter, a 23-tone test is conducted at step 316. Alternatively, or in combination, the responder may be commanded to transmit the 23-tone test to the master for analysis of the uplink path audio quality.
Decision block 318 determines if the loop is done. If the loop is not done, another call to the mobile phone at step 312 is made. If the loop 318 is done, the system hangs up at step 320, and is placed in a done state 322. With regard to tone tests, such as the 23-tone test, the system may be full duplex, half duplex or simplex.
Fig. 14 shows a flowchart for an unsuccessful completion test. From start block 330, a call is placed to the mobile phone at step 332. After a request for the current location in step 334, the results are logged in the master at step 336.
Thereafter, the system hangs up at step 338. As determined by decision block 340, if the loop is not done, the system loops back to the call mobile phone step 332, whereas if the loop 340 is done the 5 system goes to a done state 342.
Fig. 15 shows a flowchart for a dropped call test. From the start block 350, a call is placed to the mobile phone in step 352. The results are logged in the master at step 354.
Thereafter, for a predetermined period of time the system waits while tracking the current location and time at step 356. At decision block 358, if the call is still up, the system hangs 1 o up at step 360 and logs a successful call to the test processor at step 362. If the call is not still up at decision block 358, it is logged as a dropped call to the test processor at step 364.
At the loop done decision block 366, if the loop is not done, a call mobile phone step 352 is executed. If the loop done 366 is completed, the system goes to a done state 368.
Although the foregoing invention has been described in some detail by way of 15 illustration and example for purposes of clarity and understanding, it may be readily apparent to those of ordinary skill in the art in light of the teachings of this invention that certain changes and modifications may be made thereto without departing from the spirit or scope of the appended claims.
In one main intended application, this test methodology and equipment enables the wireless service provider the ability to validate service area predictive model data and to provide a survey of the quality of service and network status throughout a designated service area utilizing the wireless service providers subscriber's mobile phones.
While the system may be utilized to test for any telephony related problem consistent with the goals and objects of this invention, the main types of problems contemplated are as follows. First, unsuccessful network access may be monitored. Such an unsuccessful network access is an uplink problem wherein the wireless subscriber is unable to originate calls from a mobile phone. Secondly, the system may check for audio quality. Typically, simulation of voice conversation is performed over a wireless connection and measured from the wireless subscribers location. Both downlink call simulation and uplink call simulation may be tested. Third, unsuccessful call completion may be monitored. An unsuccessful call is 2 o defined as any call, either uplink and/or downlink, not completed as dialed. Fourth, dropped calls may be monitored. This generally is defined as any call terminated before a call termination command is initiated by either the calling or called party.
Ger~ally, the responder 42 is preferably located within a vehicle, most preferably a vehicle which moves through a relatively large geographic area within the wireless service provider region. Examples of vehicles preferably utilized with the methods of the system include:
postal or public transit vehicles (such as those that cover regular, thorough routes), delivery vehicles (such as those that cover regular routes which vary somewhat), taxis or other wireless service provider vehicles (such as those which cover random routes and sometimes go into and out of the service area}. Alternatively, the responder 42 may be placed at a 3 0 fixed location.
Fig. 3 shows a flowchart for the subscriber wireless automated remote measurement system analysis methods. The master 60 bi-directionally interfaces with a graphical user interface system 62, such as the FeatureCallT'~' system. The master 60 accesses the test processor 64. The test processor 64 in turn interacts with the database 66.
The database 66 bi-directionally accesses a configuration screen and data manager 68 various reports 70, standard and custom, may be prepared. Generally, the subscriber wireless automated remote measuring system analysis consists of the test processor 64, database 66, configuration screen and data manager 68 and report generator 70.
The database 66 must be of sufficient capacity, speed and sophistication to achieve the goals and objectives of this invention. Generally, a relational database management 1 o system (RDBMS) is utilized. In the preferred embodiment, the database 66 is Oracle Work Group for Windows NT. Among its various functions, the database 66 serves as a repository for test results and preferably contains configuration information.
The test processor 64, among other tasks, receives messages from the master 60 and translates them into SQL for the oracle database. Preferably, the test processor 64 is able to connect to multiple masters 60. Optionally, feedback may be provided from the test processor 64 to the master 60. The report package 70 preferably includes a graphical user interface (GUI) application to display test results and print reports. Derived values, e.g., signal to noise ratio, may be calculated by the report package 70. The configuration screens and data manager package 68 preferably serves to save data captured by the system for future 2 0 analysis. Generally, system 68 is a file management system for augmentation of the database 66. Optionally, the system 68 may be incorporated into the report package 70.
Optionally, a geological information system for GIS may be utilized in conjunction with the system disclosed herein. Typically, a geological information system provides through mapping software a system in which previously compiled geographic data may be 2 5 combined with newly collected and/or processed information to provide a composite image.
Such software is available from many sources, including ESRI (Environmental Systems Research Institute, Inc.), who offer programs including, but not limited to, ArcView, MapObjects, and ARC/INFO. Overlays may be utilized on the underlying data, such as location of cell sites, commercially existing map grids (e.g., Thomas Brother map grids) 3 0 or other relevant points of interest, either geographical or man-made.
The analysis components identified in Fig. 3 may be run on a single Windows NT
workstation .or notebook, or any other system which is compatible with the objects of this invention, such as Unix platforms, whether in a single work station or client-server configuration. Utilizing current technology, the system requirements would include: a single Pentium or PentiumPro processor running at or above 133 MHZ, 1.5 Gb available 5 disk space, 48 Mb of RAM, a CD-ROM, 10 base-T network card, and Windows NT
3.51 SPx or Windows NT 4.0 SPx.
Fig. 4 shows an exploded, perspective view of the responder 80 in one physical implementation. Overall, the responder 80 may be relatively compact, such as to fit within a standard vehicle trunk, and is most preferably relatively compact, in the preferred 1 o embodiment being 8 inches x 11 inches x 2.5 inches, or smaller. A base 82 is connected to a lid 84 such as by operation of a key lock system 88 which cooperatively secures the lid 84, base 82 and bracket 86. Preferably, the lid 84 is locked to the base 82 via a lock assembly 88. The bracket 86 preferably includes flanges 90 disposed on the bottom of the base to permit mounting of the responder 80, such as on the floor of a vehicle trunk.
Optionally, a bracket may be utilized to facilitate vehicle trunk or side-wall installations.
The interior of the responder 80 is preferably divided into two major components, the components being divided by a shield 92 so as to form a first compartment 94 and a second compartment 96. The first compartment 94 may contain, preferably, one or more 2 0 mobile phones 48, and may be alternatively designated as the mobile phone compartment 94. The second compartment 96 may contain responder electronics and be alternatively designated as the responder electronics compartment 96. One or more printed circuit boards 98 may be supported from the base 82 via standoffs 100. The printed circuit boards 98 may include the circuitry for the responder and, optionally, the global positioning satellite daughter board standoffs.
In yet another aspect of this invention, the combination of a standard subscriber mobile phone and a component or chip-level mobile phone may be utilized on-line simultaneously on two separate cellular or PCS calls. The results of these two separate calls may be coordinated and correlated by the analysis system.
3 0 The first compartment 94, when adapted for holding the mobile phone, preferably includes foam rubber material on both the base 82 and the lid 84. This foam rubber material serves to receive the mobile phone 48 within a nest so as to support the mobile phone 48 during vehicle motion. Optionally, a mobile phone window 102 is provided in the lid 84 to permit user observation of the mobile phone 48 panel.
The second compartment 96 is connected to the first compartment 94 by a connector 104 passing through shield 92. The mobile phone connector 106 meets with connector 104 and connects to the mobile phone 48. The mobile phone connector 106 is typically unique depending upon the type of mobile phone 48 utilized. The software utilized by the responders cellular telephone controller serves to configure the system for the specific brand of mobile telephone then utilized within the responder 80.
1 o The responder 80 includes various connections to external. An antenna connection 108 and global positioning satellite antenna connector 110 are provided. A
barrier strip 112 or water tight connector preferably provides for connection to ground 114, battery 116 and vehicle ignition 118. Preferably, provision is made to reduce risk of electrical error from electrostatic discharge through use of O-rings or elastomeric gaskets for sealing.
Fig. 5 shows an electrical block diagram of the responder electronics. A
microprocessor 110, such as Zilog microprocessor, is coupled to an address bus 112, databus 114 and control signal lines 116. A power supply 118 provides power to the system, and preferably comprises the vehicle battery. A regulator/sensor 120 provides a low battery voltage flag signal to the microprocessor 110 via the address but 112. The 2 0 regulator 120 optionally couples to a mobile phone variable voltage regulator 122, which in turn is connected to the mobile phone input/output port 124. The mobile phone input/output port 124 is preferably coupled to an analog to digital codec 126 providing phone/audio input/output. The A/D codec 126 is coupled to buses, such as address bus 112 and databus I14. Preferably, the A/D codec 126 is coupled to a digital signal processing chip 128, such as a 2171 DSP chip. The mobile phone input/output port 124 is further connected for mobile phone data and control signal communication to the mobile phone controller 130. The mobile telephone 130 is coupled to the buses, such as the address bus 112 and databus 114. External computer input/output 132 is likewise coupled to the buses.
Various control signals 134 are provided to various electronics. Chip select is 3 o effected via coupling between the address bus 112 and the control signal interface 134.
Optionally, an electronically programmable logic device (EPLD) 136 connects the chip select and control signal interface 134.
Optionally, a global positioning satellite system is utilized. A GPS daughter board 136 is coupled to the database 114. An antenna 138 connects to the daughter board 136.
Fig. 6 is a software flowchart for the responder program flow. At start-up 140, cold start begins when the power rises above 11.4 volts in a nominally 12 volt system.
Initialization 142 includes some or all of the following: global reset, start z-180 program, initialize digital signal processor and mobile telephone controller (CTC) initialize mobile phone, set call-back count to 0 and set call sequence number to 0. At "phone on" decision block 144, if the phone is not on, decision block 146 waits until the phone is turned on manually. If the phone is on, the call-back count block 148 is checked for count equals zero. If the count does not equal zero, then a call is placed to the master 150, which if not successful, block 158, is logged in the circular queue 160. A recheck is then made of the call-back count equally zero 148. If the call-back count is zero in decision block 148, the system waits for a call at block 162, receives the call at block 164, and performs a command at block 166. When completed, the system hangs up at step 168.
Fig. 7 is a flowchart for the inside wait for command program flow. After initiation at the wait for command block 170, the sequence checks the vehicle power status 172 after which the "phone off hook" decision block 174 is reached. If the phone is off hook at 2 o block 174, the hang up mobile phone block 176 is executed and a return 178 is made to the wait for command block 170. If the phone is not off hook as determined in decision block 174, decision block 182 queries whether valid DTMF command has been received at block 180. If valid DTMF commands have been received at decision block 180, various commands may be directed, including one or more of the following: receive call back 2 5 instructions 182, send current location and/or time 184, send oldest unsent unsuccessful call details 186, and receive and score 23-tone test 188. If no valid DTMF are received at block 180, the program flows into block 172. In an alternative implementation, rather than utilizing DTMF tones for communication, a modem may be utilized. Whether transmitted via DTMF or modem, it is preferred that an error checking procedure be utilized with the 3 o data transmission.
Fig. 8 shows a flowchart for the receive call back instructions sequence. The master (e.g., master 40 in Fig. 2 or 60 in Fig. 3) establishes the call 190 to the responder (e.g., 42 in Fig. 2) and transmits a prompting command and parameters at block 192 after which the master proceeds to the done with command block 194. The responder initially is in the wait for command state 196. During the transmit command " 11 " and parameters state 192, the responder is in a corresponding receive command " 11 " and parameters state 198. After receipt of the command and parameters, the call back number and call back counts are saved at block 200. The responder then returns to the wait for command state 196.
Fig. 9 shows the flowchart for the send current location/time sequence. The master begins with the established call block 210. The system then transmits command " 12" 212 to the responder. The responder begins in a wait for command state 214. After the transmit a prompting command step 212, the responder receives the prompting command in block 216. While the master is in the wait for reply state 218, the responder composes the result in state 220 and sends the result in state 222 to the master where it receives the result in state 224. After sending the result, the responder returns to the wait for command state 214. After the master receives the result in step 224, it sends the result to the test processor in block 226 after which the program is placed in a done with command state 228.
Fig. 10 shows a flowchart for the send oldest unsent unsuccessful call details program flow. The master begins with the establish call block 230. The master then 2 o transmits a prompting command at block 232 to the responder, which initially in the wait for command state 234 and then receives the prompting command in state 236.
While the master is in a wait for reply state 238, the responder finds the data in the circular queue state 240, and sends the result at block 242 to the master who receives the result at block 244. The master then sends the result to the test processor at step 246, after which the 2 5 master is done with the command at block 248.
Fig. 11 is a flowchart for the 23-tone test receiving and scoring sequence.
The 23-tone test is described in one or more of the following United States Patents No. 4,301,536, 4,417,337 and 4,768,203, incorporated herein by reference. The master establishes the call at block 250, acquires digital signal processing (DSP) resource at block 252 and transmits 3 o a prompting command at block 56 to the responder. The responder begins in a wait state 256, and receives the command from state 254 at the responder side in state 258. While the master waits. a period of time, e.g., 500 milliseconds at block 260, the responder during that wait interval 260 prepares a DSP to receive the 23-tone sequence at block 262.
The master sends the tones at step 264 and the receiver receives the tones at step 266.
Alternatively, or in combination, the responder may be commanded to transmit the 23-tone test to the master for analysis of the uplink path audio quality. The responder then processes bins and prepares results at step 268, selxiing the result at step 270 to the master which receives them at step 272. The responder then proceeds to a wait for command state 256. Upon receipt of results of step 272, the master sends the results to the test processor at step 274 after which it is placed in a done with command state 276.
Fig. 12 shows a flowchart for the network access test. After start block 280, a call is placed to the mobile phone at step 282 after which call back instructions are sent at step 284. The system then hangs up and waits for a call at step 286, and is optionally subject to a time out 288. If the call is placed, the call is then accepted at step 290, where upon a request for the current location is made at step 292. A request for the oldest unsent unsuccessful call details step 294 is made. At decision block 296, if the system has not received all unsent data, the system loops to yet again request the oldest unsent unsuccessful call detail step 294. If all unsent data has been received as determined at decision block 296, decision block 298 determines whether more call attempts are necessary.
If not, the program flows to a done state 300, whereas if more call attempts are required the program 2 o flows to the hang up and wait for call state 286.
Fig. 13 shows a flowchart for an audio quality test. From start block 310, a call is placed to the mobile phone at step 312, upon which a request is made for the current location in step 314 as determined by the responder. Thereafter, a 23-tone test is conducted at step 316. Alternatively, or in combination, the responder may be commanded to transmit the 23-tone test to the master for analysis of the uplink path audio quality.
Decision block 318 determines if the loop is done. If the loop is not done, another call to the mobile phone at step 312 is made. If the loop 318 is done, the system hangs up at step 320, and is placed in a done state 322. With regard to tone tests, such as the 23-tone test, the system may be full duplex, half duplex or simplex.
Fig. 14 shows a flowchart for an unsuccessful completion test. From start block 330, a call is placed to the mobile phone at step 332. After a request for the current location in step 334, the results are logged in the master at step 336.
Thereafter, the system hangs up at step 338. As determined by decision block 340, if the loop is not done, the system loops back to the call mobile phone step 332, whereas if the loop 340 is done the 5 system goes to a done state 342.
Fig. 15 shows a flowchart for a dropped call test. From the start block 350, a call is placed to the mobile phone in step 352. The results are logged in the master at step 354.
Thereafter, for a predetermined period of time the system waits while tracking the current location and time at step 356. At decision block 358, if the call is still up, the system hangs 1 o up at step 360 and logs a successful call to the test processor at step 362. If the call is not still up at decision block 358, it is logged as a dropped call to the test processor at step 364.
At the loop done decision block 366, if the loop is not done, a call mobile phone step 352 is executed. If the loop done 366 is completed, the system goes to a done state 368.
Although the foregoing invention has been described in some detail by way of 15 illustration and example for purposes of clarity and understanding, it may be readily apparent to those of ordinary skill in the art in light of the teachings of this invention that certain changes and modifications may be made thereto without departing from the spirit or scope of the appended claims.
Claims (35)
1. A method for testing a wireless service provider network comprising the steps of:
initiating one or more outbound call attempts under control of a master to one or more automatic, mobile responders, receiving calls at at least some of the automatic, mobile responders, monitoring parameters of the network during the call between the master and the automatic, mobile responder, and transmitting information indicative of the parameters to the master.
initiating one or more outbound call attempts under control of a master to one or more automatic, mobile responders, receiving calls at at least some of the automatic, mobile responders, monitoring parameters of the network during the call between the master and the automatic, mobile responder, and transmitting information indicative of the parameters to the master.
2. The method of claim 1 for testing a wireless service provider network wherein the parameter tested includes quantitative and qualitative testing.
3. The method of claim 1 for testing a wireless service provider network wherein the testing includes audio quality testing.
4. The method of claim 3 for testing a wireless service provider network wherein the audio quality testing includes a 23-tone test.
5. The method of claim 4 for testing a wireless service provider network wherein the 23-tone test is in half duplex.
6. The method of claim 4 for testing a wireless service provider network wherein the 23-tone test is full duplex.
7. The method of claim 4 for testing a wireless service provider network wherein the 23-tone test is simplex.
8. The method of claim 1 for testing a wireless service provider network wherein the testing includes monitoring the radio frequency power.
9. The method of claim 1 for testing a wireless service provider network wherein the testing includes monitoring frequency.
10. The method of claim 1 for testing a wireless service provider network wherein the testing includes spectrum analysis.
11. The method of claim 1 for testing a wireless service provider network further including collection and transmission of information regarding global positioning.
12. The method of claim 11 for testing a wireless service provider network wherein the global positioning information includes position.
13. The method of claim 11 for testing a wireless service provider network wherein the global positioning information includes the time as provided by the global positioning system.
14. The method of claim 11 for testing a wireless service provider network wherein the velocity of the mobile responder is determined.
15. The method of claim 1 for testing a wireless service provider network wherein the transmission of information indicative of the parameters is performed in a call initiated by the master to the responder.
16. The method of claim 1 for testing a wireless service provider network wherein the step of transmitting information indicative of the parameters is performed in a call initiated by the responder to the master.
17. The method of claim 1 for testing a wireless service provider network further including the step of analyzing the information transmitted to the master.
18. The method of claim 1 for testing a wireless service provider further including the step of displaying the information provided from the responders to the master.
19. The method of claim 1 for testing a wireless service provider network further including the step of archiving data supplied to the master in real time.
20. The method of claim 1 for testing a wireless service provider network further including the step of displaying information regarding the network in real time.
21. The method of claim 1 for testing a wireless service provider network further including the step of displaying geological information systems data in real time.
22. The method of claim 1 for testing a wireless service provider network further including the step of collecting data regarding calls not received.
23. A method for testing communication between a first wireless communication device and a second wireless communication device over a wireless service provider network, comprising the steps of:
first, initiating a call from a master to a first responder including the first wireless communication device, second, initiating a call from the first wireless communication device to the second wireless communication device in a second responder over the wireless service provider network, monitoring parameters of the call, and communicating to the master information regarding the call between the first wireless communication device and the second wireless communication device.
first, initiating a call from a master to a first responder including the first wireless communication device, second, initiating a call from the first wireless communication device to the second wireless communication device in a second responder over the wireless service provider network, monitoring parameters of the call, and communicating to the master information regarding the call between the first wireless communication device and the second wireless communication device.
24. The method of claim 23 for testing communication between wireless communication devices wherein at least one of the first and second wireless communication devices is a mobile phone.
25. The method of claim 23 for testing communication between wireless communication devices wherein at least one of the first and second wireless communication devices is a personal communications systems device.
26. A system for testing a wireless communication network comprising:
a master for automatically initiating calls, adapted for connection to a switched network including a wireless service provider network, one or more wireless responders adapted to automatically communicate with the master via the switched network, and an analysis system for receiving information from the responders through the wireless network in real time for providing test results regarding the wireless network.
a master for automatically initiating calls, adapted for connection to a switched network including a wireless service provider network, one or more wireless responders adapted to automatically communicate with the master via the switched network, and an analysis system for receiving information from the responders through the wireless network in real time for providing test results regarding the wireless network.
27. The system of claim 26 for testing a wireless network wherein the analysis system includes a test processor.
28. The system of claim 26 for testing a wireless network wherein the analysis system includes a database for archiving test information.
29. The system of claim 26 for testing a wireless network wherein the analysis system includes a graphical user interface.
30. The system of claim 26 for testing a wireless network wherein the public switch network further includes the public switched telephone network.
31. A mobile responder for testing a wireless service provider network between a base station including a master and a wireless communication device located at the mobile responder, comprising:
an antenna connection adapted for communication with the wireless service provider network, a wireless communication device receptacle adapted to receive a wireless communication device, a responder control system including, a wireless communication device controller, a parametric test system, and a test result provision system adapted to provide test results to the master, and a power connection for providing power to the responder control system.
an antenna connection adapted for communication with the wireless service provider network, a wireless communication device receptacle adapted to receive a wireless communication device, a responder control system including, a wireless communication device controller, a parametric test system, and a test result provision system adapted to provide test results to the master, and a power connection for providing power to the responder control system.
32. T'he mobile responder of claim 31 for testing a wireless service provider network wherein the responder includes two or more separate compartments.
33. The mobile responder of claim 32 wherein a first compartment is adapted to receive the wireless communication device.
34. The mobile responder of claim 32 wherein a second compartment includes the responder control system.
35. The mobile responder of claim 32 further including a pass through connection between the compartments.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US92182697A | 1997-09-02 | 1997-09-02 | |
| US08/921,826 | 1997-09-02 | ||
| PCT/US1998/016763 WO1999012228A2 (en) | 1997-09-02 | 1998-08-21 | Apparatus and methods for automated testing of wireless communications systems |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2302399A1 true CA2302399A1 (en) | 1999-03-11 |
Family
ID=25446031
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002302399A Abandoned CA2302399A1 (en) | 1997-09-02 | 1998-08-21 | Apparatus and methods for automated testing of wireless communications systems |
Country Status (4)
| Country | Link |
|---|---|
| EP (1) | EP1033022A2 (en) |
| AU (1) | AU9018298A (en) |
| CA (1) | CA2302399A1 (en) |
| WO (1) | WO1999012228A2 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118800279A (en) * | 2023-10-09 | 2024-10-18 | 中国移动通信集团浙江有限公司 | Training method and device for speech quality assessment model |
Families Citing this family (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6522888B1 (en) * | 1999-08-31 | 2003-02-18 | Lucent Technologies Inc. | System for determining wireless coverage using location information for a wireless unit |
| KR100429190B1 (en) * | 1999-09-09 | 2004-04-28 | 엘지전자 주식회사 | Packet call automatic testing device in communication system and packet call automatic testing method |
| AU2002245618A1 (en) * | 2001-03-06 | 2002-09-19 | At And T Wireless Services, Inc. | Method and system for real-time network analysis and performance management of a mobile communications network |
| US8977284B2 (en) | 2001-10-04 | 2015-03-10 | Traxcell Technologies, LLC | Machine for providing a dynamic data base of geographic location information for a plurality of wireless devices and process for making same |
| ES2205991B2 (en) * | 2001-10-23 | 2005-09-16 | Telefonica S.A | UMTS RADIO BEAM EQUIPMENT. |
| US7224968B2 (en) | 2001-11-23 | 2007-05-29 | Actix Limited | Network testing and monitoring systems |
| GB2382502B (en) | 2001-11-23 | 2005-10-19 | Actix Ltd | Network testing systems |
| US6917916B2 (en) | 2001-12-13 | 2005-07-12 | Motorola, Inc. | Method and apparatus for testing digital channels in a wireless communication system |
| KR101198246B1 (en) * | 2003-11-17 | 2012-11-07 | 텔레콤 이탈리아 소시에떼 퍼 아찌오니 | Quality of Service Monitoring Architecture, related Method, Network and Computer Program Product |
| FR2869189B1 (en) * | 2004-04-16 | 2006-06-02 | Thales Sa | METHOD FOR CONTROLLING AND ANALYZING COMMUNICATIONS IN A TELEPHONY NETWORK |
| US7707031B2 (en) * | 2005-03-01 | 2010-04-27 | Telefonaktiebolaget Lm Ericsson (Publ) | Large scale measurement of subjective quality in mobile communications systems |
| US8442248B2 (en) | 2008-09-03 | 2013-05-14 | Starkey Laboratories, Inc. | Systems and methods for managing wireless communication links for hearing assistance devices |
| CN102098714B (en) * | 2009-12-11 | 2013-06-05 | 联芯科技有限公司 | Terminal power consumption testing system and testing method |
| KR101875987B1 (en) | 2011-02-14 | 2018-07-06 | 톰슨 라이센싱 | Troubleshooting wi-fi connectivity by measuring the round trip time of packets sent with different modulation rates |
| US8904237B2 (en) | 2012-07-17 | 2014-12-02 | Qualcomm Innovation Center, Inc. | Framework for testing and evaluating mobile communication devices |
| CN103179241B (en) * | 2013-03-08 | 2018-11-09 | 百度在线网络技术（北京）有限公司 | A kind of automated testing method and system of mobile terminal power consumption |
| US9584927B2 (en) | 2013-03-15 | 2017-02-28 | Starkey Laboratories, Inc. | Wireless environment interference diagnostic hearing assistance device system |
| CN110018392B (en) * | 2019-04-12 | 2021-11-19 | 许继集团有限公司 | Test system of distribution automation system main station |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4301536A (en) * | 1979-12-28 | 1981-11-17 | Bell Telephone Laboratories, Incorporated | Multitone frequency response and envelope delay distortion tests |
| US5095500A (en) * | 1989-12-07 | 1992-03-10 | Motorola, Inc. | Cellular radiotelephone diagnostic system |
| US5410737A (en) * | 1992-04-27 | 1995-04-25 | American Pcs L.P. | Frequency agile sharing technology (FAST) for a personal communications service system |
| US5425076A (en) * | 1992-06-30 | 1995-06-13 | Minnesota Mining And Manufacturing Company | Cellular communications test system |
| SE500769C2 (en) * | 1993-06-21 | 1994-08-29 | Televerket | Procedure for locating mobile stations in digital telecommunications networks |
-
1998
- 1998-08-21 CA CA002302399A patent/CA2302399A1/en not_active Abandoned
- 1998-08-21 EP EP98942045A patent/EP1033022A2/en not_active Withdrawn
- 1998-08-21 AU AU90182/98A patent/AU9018298A/en not_active Abandoned
- 1998-08-21 WO PCT/US1998/016763 patent/WO1999012228A2/en not_active Ceased
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118800279A (en) * | 2023-10-09 | 2024-10-18 | 中国移动通信集团浙江有限公司 | Training method and device for speech quality assessment model |
| CN118800279B (en) * | 2023-10-09 | 2025-10-31 | 中国移动通信集团浙江有限公司 | Training method and apparatus for speech quality assessment model |
Also Published As
| Publication number | Publication date |
|---|---|
| WO1999012228A9 (en) | 1999-05-14 |
| WO1999012228A2 (en) | 1999-03-11 |
| AU9018298A (en) | 1999-03-22 |
| EP1033022A2 (en) | 2000-09-06 |
| WO1999012228A3 (en) | 2000-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2302399A1 (en) | Apparatus and methods for automated testing of wireless communications systems | |
| KR100725002B1 (en) | Wireless network service quality diagnosis system of mobile internet system and its diagnosis method | |
| EP0891113B1 (en) | Method and apparatus for field testing cellular telephones | |
| US7996004B2 (en) | Wireless communication system and test method thereof, and access terminal for testing wireless communication system | |
| US7324588B2 (en) | Apparatus, and associated method, for testing a mobile terminal in test conditions that emulate an operating environment | |
| US5425076A (en) | Cellular communications test system | |
| US6970702B1 (en) | Cellular communications drive test system and method | |
| WO1993015569A1 (en) | Automatic cellular telephone control system | |
| JP3760388B2 (en) | Test transceiver for cell planning | |
| WO2006005947A1 (en) | Testing device and method | |
| US6091950A (en) | System and method for the control of a cellular radiocommunications network by means of a set of protocol analyzers and mobile stations | |
| US6782256B2 (en) | Measuring wireless network performance via a world wide network | |
| US5924029A (en) | Mobile radio transmission system with integrated measuring device for measuring the radio coverage area | |
| FI117846B (en) | Quality of call service system | |
| KR100346999B1 (en) | System for managing and measuring a real feeling quality of wireless data service and method the same | |
| JP2000101503A (en) | Test device for communication equipment | |
| JP4487451B2 (en) | Mobile terminal maintenance system and method | |
| AU5430296A (en) | Method and apparatus for optimizing and testing a communication system | |
| US20070270195A1 (en) | Roaming function test system and method | |
| CN102546825B (en) | A kind of long-distance monitoring method of automatic drive test system and device | |
| GB2416280A (en) | Testing device and method | |
| Ko | Automatic call generation and analysis-network testing and cellular survey tools | |
| JP2973806B2 (en) | Cordless telephone test system | |
| CN117956513A (en) | Non-standard 4G-LTE communication network integration and test method based on flight platform | |
| Rojatkar | Development of a methodology for the assessment of the real-life exposure due to electromagnetic fields |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FZDE | Discontinued | ||
| FZDE | Discontinued |
Effective date: 20010821 |