WO2023035017A1

WO2023035017A1 - Personal observer system

Info

Publication number: WO2023035017A1
Application number: PCT/ZA2022/050045
Authority: WO
Inventors: Robert Sbusiso BENTELE; Sibusiso MBHELE; Masakhane Simiso NGWENYA; Phumulani Edward NGWENYA
Original assignee: Greeneye Consortium Pty Ltd
Current assignee: Greeneye Consortium Pty Ltd
Priority date: 2021-09-06
Filing date: 2022-09-06
Publication date: 2023-03-09
Anticipated expiration: 2024-03-06

Abstract

This invention relates to a personal tracking system comprising a computer software application ("app") configured for downloading, installation and implementation in location aware mobile devices. The app includes a participating user module programmed for installation in a participating user's mobile device, an observer module programmed for installation in an observer's mobile device, participating user and observer registration functions as well as participating user tracking and geospatial functions. The app includes an emergency management function by means of which either or both the participating user and observer devices may be used to generate an emergency action, either consciously or automatically.

Description

PERSONAL OBSERVER SYSTEM

Field of the invention

[001] This invention relates to a personal tracking system implemented on location-aware mobile communication devices.

Background to the invention

[002] Location-aware devices make use of a combination of computer hardware and software in the device to access and process geospatial data. Unlike dedicated navigators, which receive geospatial data solely from global navigation satellite systems (GNSS), mobile phones and other mobile communication devices receive and process GNSS data as well as geospatial data derived from the mobile communications network. Being radio-enabled, mobile communication devices (herein “mobile devices” are capable of communicating geospatial data to the network and to other mobile devices on the network, as a result of which, mobile devices have become an almost ubiquitous platform for the delivery of location-based services (LBS), software services which utilise geospatial data to provide services or information to mobile device users. LBS is used in a variety of applications and contexts, including navigation, object search, and in users' work and personal life. Commonly used examples of LBS include navigation software and systems, financial services and financial services security in particular, social networking services, and location-based advertising. Location awareness might be used to enable automatic reconfiguration of a mobile computing device to suit the location in which it is currently being used, for example by displaying new map locations as the user moves around or allowing the display of commercial offerings for sale by vendors in dependence on the user’s geospatial proximity to the vendor.

[003] In addition, and, since mobile devices are typically carried around by individual users, location awareness might be used to enable publication of the mobile device location and therefore of the user's location. Privacy concerns demand that such personal tracking applications, which publish a user’s location be restricted, for example, to approved members of the user’s social network.

[004] Examples of personal tracking systems include FindMy™, which is an asset tracking application or app provided by Apple Inc. that enables Apple device users to track the location of Apple mobile devices. Users can also share the GPS location of their Apple device to specifically selected users of Apple devices. The selected users have the option of also sharing their GPS location with the first user. Once shared, the selected users are able to see the exact location of the sharing user’s device on a map and can receive directions to the person's location. Notifications can be set, alerting a user when someone leaves or arrives at a predetermined location.

[005] Certain personal tracking systems incorporate functionality to summon assistance in an emergency. An example of such a system is the South African Namola™ app that allows the user to request emergency assistance using the mobile device GPS location. Upon receiving such a request, the Namola™ control centre will call the user to confirm details of the emergency and to dispatch assistance from nearby security services or other emergency services. The Namola™ includes functionality to add a number of the user’s contacts as emergency contacts who will be alerted and kept informed if the user requests emergency services on the app. Summary of the invention

[006] According to one aspect of this invention, a personal observer system comprises: a plurality of participating location-aware, communications- enabled mobile devices each including programmable logic means, an interactive user interface, audiovisual capture and display means, and geospatial functionality (in this specification referred to as “mobile devices"); and a computer software application (in this specification referred to as an “app”) comprising computer program code configured for downloading, installation and implementation in the mobile devices, the app comprising at least a participating user module and an observer module, in respect of which: the participating user module is programmed for installation in a participating user’s mobile device and, upon installation in the participating user mobile device, programs the mobile device programmable logic means to implement a participating user mode in which the mobile device functions as a participating user mobile device programmed to implement a predetermined participating user registration function, an observer registration function, a participating user tracking function, a geospatial function and an emergency management function; the observer module is programmed for installation in an observer's mobile device and, upon installation in the participating user mobile device, programs the mobile device programmable logic means to implement an observer mode in which the mobile device functions as an observer mobile device programmed to implement a predetermined observer registration function, a participating user tracking function, a geospatial function, and an emergency management function, in which: the participating user registration function includes means to enable registration of a prospective user as a participating user and the participating user mobile device as a participating user device on the personal observer system; the observer registration function includes means to enable registration of the observer and the observer mobile device as an observer device on the personal observer system; the participating user tracking and geospatial functions include means to enable geospatial location of the participating user mobile device and the display of geospatial data pertaining to the current geographic location of the participating user mobile device on the visual display means of the participating user and observer mobile devices; and the emergency management function includes, on both the participating user and observer devices, means to enable either or both the participating user or observer mobile devices to generate an emergency action and, on the participating user device, means to generate an emergency action automatically in dependence on at least one sensed parameter; each of the means to enable registration, geospatial location, the display of geospatial data and the means to enable generation of an emergency action being implemented in the mobile devices by the participating user and observer modules including programs that program each mobile device to produce appropriate interactive displays and interaction prompts on the mobile device interactive interface.

[007] In respect of participating user and observer mobile devices that include, as an interactive interface, a graphical user interface (GUI), the geospatial function of displaying geospatial data is preferably implemented in the mobile devices by the participating user and observer modules including programs that program the mobile device to display the geospatial data pertaining to the participating user mobile device as a map display on the GUI of the participating user and observer mobile devices respectively.

[008] In this form of the invention, the mobile device, in each case, is programmed for the interface to display the location of the participating user mobile device as an icon or marker on a geographic map displayed on the GUI, the map marker icon being located at a displayed map location corresponding to the actual geographic location of participating user mobile device.

[009] A participating user is a person (almost invariably a natural person) who elects to participate in and use the personal observer system of the invention by registration of the participating user on the personal observer system for purposes of being tracked and observed by trusted observers, normally on specific occasions, such as when the user travels from a trusted to a less trusted location.

[0010] An observer is a person (almost invariably a natural person) who agrees with the user to act as an observer in response to an invitation from the user and who agrees to registration of the observer on the personal observer system for purposes of tracking the progress of the participating user when requested to do so by the participating user.

[0011] The emergency action forming part of the emergency management function may include, in respect of both the participating user and observer mobile devices, means to enable either or both the participating user and observer mobile devices to initiate an emergency action, the emergency management function including: in respect of the participating user mobile device, program code forming part of the participating user module that programs the mobile device to initiate an emergency action automatically in dependence on at least one sensed parameter; and in respect of both the participating user and observer mobile devices, program code forming part of the participating user and observer modules that, in each case, programs the mobile device to prompt the participating user and/or the observer, as the case may be, by way of the mobile device interface, to initiate the emergency action.

[0012] The program code preferably programs the mobile device to prompt the participating user or observer to actuate an actuator incorporated in the mobile device.

[0013] The actuator may be a repurposed button of the mobile device, but for mobile devices that incorporate a GUI, the actuator is presented as a virtual actuator on the GUI that the participating user or observer may tap or swipe across the mobile device display screen to actuate.

[0014] The emergency action initiated by the mobile device is preferably constituted by a mobile device signal emitted or transmitted by the mobile device.

[0015] The signal may include anything from an alert or an alarm signal generated by or by means of the mobile device to the mobile device transmitting a request to an emergency service provider, such as security or medical personnel, to assist at the participating user’s current geographic location.

[0016] The means to generate an emergency action automatically forms part of the participating user module and preferably comprises program code forming part of the participating user module program code that programs the mobile device to monitor for the occurrence of one or more predetermined parameters and to generate an emergency action automatically in the event that the monitored parameter eventuates.

[0017] In this embodiment of the invention, the monitored parameter could be a predetermined deviation from the participating user's specified route of travel or from the travel time specified, or it could be a specific sound, such as a keyword uttered by the participating user or a predetermined change in the participating user’s physical demeanour. [0018] In an instance where there is a predetermined deviation from the participating user’s specified route of travel or from the travel time specified, the participating user may be prompted to actuate an actuator or enter a previously programmed (by the user) Personal Identification Number (PIN) to indicate the user’s safety status. If the participating user does not actuate the actuator, enter the PIN or enters an incorrect PIN either immediately or within a pre-set entry period (anything between 10 and 20 seconds), an emergency action is automatically generated.

[0019] The app may be programmed to initiate an emergency action when the mobile device is shaken by the participating user.

[0020] The app may further be programmed to provide a so-called dead man’s trigger mode. This is a mode in which the app is programmed to display a button on the user's mobile device GUI that requires constant user touch on the button to keep the button deactivated. In the event that the user releases the user’s touch on the button, the button is automatically activated and an emergency action is generated. In the preferred embodiment of this form of the invention, the dead man’s trigger is preferably programmed to generate an emergency action only if the user fails to enter the user’s PIN within a predetermined period of time after the button is released. The PIN entry period should preferably be relatively short, for example anything between 10 and 20 seconds.

[0021] The app may conveniently include a companion module in addition to the participating user and observer modules, the companion module being programmed for installation in a companion’s mobile device and, upon installation in the companion mobile device, to program the mobile device programmable logic means to implement a companion mode in which the mobile device functions as a companion mobile device programmed to implement a predetermined companion registration function, a participating user and companion tracking function, geospatial and emergency management functions.

[0022] The app may further include a service provider module programmed for installation in a service provider’s mobile device and, upon installation in the service provider mobile device, to program the mobile device programmable logic means to implement a service provider mode in which the mobile device functions as a service provider mobile device programmed to implement a predetermined service provider registration function, a participating user and service provider tracking function, geospatial and emergency management functions.

[0023] The registration function is programmed to enable participating user, observer, companion and service provider registration, the app modules being programmed to enable the participating user to register the companion and service provider mobile devices, respectively, to the participating user’s mobile device and to display current geographic location of the companion and/or service provider user mobile devices on the observer mobile devices.

[0024] The companion could be a person accompanying the participating user to an event, such as a date or function for instance.

[0025] The service provider could be a ride hailing service provider, such as an Uber™ driver or it could be an emergency service provider, such as a security service provider or a medical service provider.

[0026] In each case, the companion and service provider modules, respectively, are used to establish the identity and the continuing proximity of those persons to the participating user, as observed by the observers. In principle, the registration of the companion and service provider mobile devices to the participating user mobile device serves to pass through an authorisation to be tracked.

[0027] In another embodiment, the invention may include an independent electronic device in the form of a panic button having a separate Subscriber Identity Modular (SIM) card and GPS. When the panic button is triggered, emergency services and the participating user’s observers are alerted of an emergency action. The panic button may also be linked to the app.

Brief Description of the drawings

[0028] Embodiments and implementations of the personal observer system of the invention are described below with reference to series of diagrams which illustrate a personal observer system according to the invention, implemented as an app on smartphones.

[0029] The diagrams are simplified screenshots illustrating individual smartphone display screens, each of which illustrates a different aspect of the personal observer system of the invention.

Description of embodiments of the invention

[0030] The personal observer system of the invention improves and develops on the basic personal tracking systems currently available.

[0031] In the preferred embodiment of the invention, the personal observer system of the invention essentially comprises multiple interoperative systems, including a back-end administration system and a software application or app which is downloadable for installation onto mobile devices, in respect of which the system makes allowance for four different user types. Each user type will use the app differently and for each user type, therefore, the app will present and display slightly differently. The user types comprise: a participating user: — a person, who might be but need not necessarily be an individual, natural person, who wishes to be tracked or observed and who registers on the personal observer app to become a participating user; an observer: — a person, who might be but need not necessarily be an individual, natural person, who accepts the invitation of a participating user to become an observer and who registers on the personal observer app to become an observer in relation to the participating user who issued the invitation; a companion: — a person who accompanies the participating user to an event (the term is intended to cover private events, such as a date or blind date as well as public events and event venues, such as a show, concert or nightclub) and who accepts the request of a participating user to become that user’s companion for a predetermined time and who is registered on the personal observer app as a companion in relation to the participating user who issued the request; and a service provider: — a person who provides the participating user with a service (the term is intended to cover most services, from services rendered in an emergency, such as emergency security and medical services, through services rendered at the participating user’s home, such as home maintenance services, to ride hailing services, such as an Uber™ service) and who accepts the request of a participating user to become a registered service provider of the requesting participating user for a predetermined time and who is registered on the personal observer app as a service provider in relation to the participating user who issued the request.

[0032] The back-end system is used to administer the entire system, including the apps installed on multiple user mobile devices and the interaction between the apps, as installed on the mobile devices of the multiplicity of users. The back-end administration system may be hosted for Internet and GSM/GPRS communications as between the administration system and the apps installed on the mobile devices of the multiplicity of users.

[0033] The back-end administration system presents the app to prospective users (participating users, observer users, companion users and service provider users) for downloading by way of Internet app stores, the system being downloadable as a mobile device software app.

[0034] In this description of embodiments of the invention, the mobile device app implementations of the personal observer system of the invention will be referred to as the “app" and the back-end administration system supporting the personal observer system of the invention will be referred to as the “system".

[0035] In the older and newer examples of the system and app described below, the mobile device illustrations are derived from smartphone screenshots. Notwithstanding the reference to smartphones as the exemplary mobile devices, it will be appreciated that the personal observer app may be configured for installation and implementation on less high-end mobile computing devices, as long as the devices are location-aware, communications-enabled and include programmable logic means, an interactive user interface, audiovisual capture and display means, and geospatial functionality. In this regard, the mobile computing devices may be any manner of portable or mobile computing devices, including laptop computers, tablet computers, mobile phones, and smartwatches.

[0036] Almost all mobile devices nowadays, whether smartphones or earlier generation mobile devices, are location-aware and include geospatial functionality in the form of a GNSS chipset and appropriate software.

[0037] The rise in popularity of touchscreen smartphones and mobile apps distributed via app stores along with rapidly advancing network-, mobile processor-, and storage technologies has given rise to technological convergence in which separate mobile devices have been replaced almost universally by the smartphone as the single mobile device most people carry.

[0038] The programmable logic means in mobile devices typically consists of integrated circuit-based central processing units (CPUs), similar to those in computers. In smartphones, the CPU is typically integrated in a system-on-a-chip (SoC) application processor.

[0039] The programs that run within the mobile device programmable logic means are based on mobile operating system software that combines features of personal computer operating systems with other features useful for mobile or handheld use, which features typically include hardware and software to provide touchscreen functionality, radio functionality, including cellular communications, Bluetooth™, WiFi™ and near field radio frequency communication (NFC), Global Positioning System (GPS) capabilities, mobile navigation functionality, video- and still image camera capabilities and audio functionality, including sound recording, sound playback, speech recognition and more.

[0040] Cameras have become standard features of smartphones. Advances in digital camera sensors and on-device image processing software has gradually led to smartphones replacing simpler cameras for photographs and video recording.

[0041] The same has happened to GNSS which, in most smartphones is constituted by the US-based GPS system. The built-in GNSS capabilities and mapping apps on smartphones have largely replaced stand-alone satellite navigation devices and paper maps.

[0042] More recently, smartwatches have converged technologically with smartphones and hence are considered mobile devices, as defined above. While early smartwatch models could perform little more than basic tasks, mainly centred on biomonitoring and time-telling, smartwatches now have functionality closer to smartphones, including mobile apps, a mobile operating system, WiFi™/Bluetooth™ connectivity and audiovisual facilities, often coupled with a Bluetooth™ headset.

[0043] The mobile devices described immediately above all have graphical user interfaces (GUIs) of varying degrees of sophistication, but each GUI provides an interactive user interface and audiovisual display and data capture functionality, the latter typically presented in the form of virtual buttons and sliders that are displayed for activation or manipulation on the GUI display screen.

[0044] Before the app can be implemented on a mobile device, the user (each user type) will be prompted to register on the app and, by extension, the app/system operator’s back-end administration system, by providing personal identification details appropriate to the user type. In this regard: a participating user will be required to provide comprehensive personal details, including conventional personal identification details, such as name, address, and other contact information as well as personal medical condition and medical aid details; an observer will be required to provide little more than a name; a companion will be required to provide name, and physical address details; and a service provider will be required to provide name, and business address details, including details like motor vehicle registration number, particularly when the service provider is a ride hailing service provider.

[0045] The app and back-end administration system captures the mobile device numbers of participating users, observers, companions, and service providers by recording the participating user’s details on first access and registration and by recording mobile device numbers from the invitation or request issued to observers, companions and service providers which, in each case, will be issued from the participating user mobile device to the mobile device of the observer, companion or service provider.

[0046] The personal observer app is preferably configured to provide the participating user with an option to request security or emergency service providers contracted to the participating user to register as service providers related to the participating user. In this way, the participating user could, for example, arrange registration of the user’s regular security or medical service providers to ensure that it is these service providers who attend on the participating user in an emergency.

[0047] Examples of an older version of the app of the invention are described below with reference to diagrams constituted by screenshots illustrating individual smartphone display screens of an early prototype of the app and in which the observers are referred to as “guardians”.

Geographic Location

[0048] In the app, geospatial data pertaining to the participating user mobile device (and therefore the participating user) is displayed as a map display on the GUI of the various mobile devices.

[0049] The mobile device, in each case, is programmed for the device GUI to display the location of the participating user mobile device as a marker icon on a geographic map displayed on the GUI.

[0050] The marker icon is located at a displayed map location corresponding to the actual geographic location of participating user mobile device.

Download and Introduction

[0051] Upon first accessing the app, at least the participating user and preferably also observers, are presented with a series of introductory, explanatory mobile device display screens that describe the basic functionality of the app. [0052] These functions are described in more detail below.

Registration and Settings

[0053] When each user type registers on the app, the user is first taken through a registration and setting-up process.

[0054] In the registration process, the user will be prompted to register on the app and, by extension, the system operator's back-end administration system.

[0055] The user will be required to provide identification details appropriate to the user type, including the user’s name and, in some cases, address and other contact information as well as personal medical condition and medical aid details.

[0056] Users will also be required to set up their mobile devices by enabling certain settings, as set out in the settings screen of the app illustrated in the screenshot above.

Adding Observer Function

[0057] Once a participating user has registered their user profile on the app, the app prompts the user to add one or more observers or guardians (in the example illustrated).

[0058] The participating user is prompted to add an observer or guardian (left-most screen illustrated above). As indicated, the exemplary app refers to the observers as "guardians”. These are trusted contacts who will be notified and updated of the participating user's geographical location and safety status in real time in use.

[0059] Observers are selected from trusted contacts, whose contact details could be (but need not necessarily be) in the participating user’s list of contacts on the participating user's mobile device (left-centre screen above).

[0060] Once selected, the app is programmed to send a message to the invited observers (right-centre screen above). Short Messaging Service (SMS) is the preferred messaging format, since older generation mobile devices are SMS-compatible, but these devices might not be compatible with newer IM (Instant Messaging) formats, such as WhatsApp™, Telegram™ and the like.

[0061] The message includes a clickable link that, in the example illustrated is constituted by an Internet URL, but that could simply be a virtual button displayed on the invited recipient’s mobile device GUI.

[0062] The prospective observer accepts the invitation by clicking on the link or the appropriate button.

[0063] Observers may be invited generally and on a reasonably permanent basis, with a view to such relatively permanent observers serving to track virtually all movement of the participating user. Alternatively, observers may be invited for a limited period of time, with pre-set start and end times or even on a once-off basis for purposes of tracking the participating user in respect of a specified event, for example to confirm that the participating user attends a specified business meeting. Observers could also be delisted, either generally or in respect of a specified event if, for example, the participating user does not want a particular observer to track the participating user in relation to the specified event.

[0064] Unless a contact selected to be added as an observer has been previously registered as an observer, that contact is unlikely to have the personal observer app installed on their mobile device and the app will first have to be downloaded to the prospective observer’s mobile device. For this eventuality, the personal observer system of the invention system directs the observer to download the app from an app store. However, the app may also be programmed such that the prospective observer’s acceptance of the participating user’s invitation triggers an automatic download that downloads the app or at least the observer implementation of the app automatically to the mobile device of the observer user.

[0065] Once an observer has been added, the observer will appear in the user's observer list.

[0066] Non-distant observers are also displayed on a map display on the GUI of the participating user’s mobile device (right-most screen above), the app being programmed to display map marker icons showing the geographic location of observers located within a 20km distance of the geographic location of the participating user.

[0067] Observers are classified into: prospective observers, being prospective observers who have been invited to become observers but who have not yet accepted the participating user's observer invitation — for whom a yellow map marker icon is displayed; and verified observers, being observers who have been invited to become observers and who have accepted the participating user's observer invitation — for whom a blue map marker icon is displayed.

[0068] The participating user's geographic location is displayed at the centre of the map display by means of a green map marker icon. The map display provides the participating user with an immediate graphic representation of the proximity of the user’s trusted network.

Events and Checking-in

[0069] The participating user implementation of the app relies on the use of event entries by means of which the participating user from time to time enters a specified event, venue or activity in respect of which the user requires observer monitoring.

[0070] The event, venue or activity is conveniently selected from a selection screen (left -most screen above) that provides the participating user with a selection of events, venues and activities. [0071] When the user plans or is aware of an event that could require the sharing of their real time geographic location and safety status to one their trusted network, the participating user selects an event, venue or activity. The list includes travel between destinations, going on a date, attending a meeting, attending a social gathering, and any situation where the participating user is in an unfamiliar location and/or with unfamiliar people that could pose a risk to their safety.

[0072] The “add event" screen (centre screen above) allows the participating user to enter details of the event, venue or activity.

[0073] This screen also provides the user with an opportunity to invite specific observers to observe/track the participating user.

[0074] The screen includes a slider button that provides the participating user with an option to enable GNSS and live check-ins.

[0075] The check-in function programmed into the app creates repeating check-in intervals at which the user is prompted to check into the app. In the preferred form of this embodiment of the invention, the user checks into the app by entering a previously programmed (by the user) Personal Identification Number (PIN). The use of prompt may be a silent vibration combined with a PIN pop-up, the app being programmed to display a PIN pop-up onto the device GUI into which the user is required to enter the PIN to complete live check-in. The silent vibration enables the user to check-in discreetly if discretion is required.

[0076] The check-in interval is a period of time that could be preprogrammed into the app and hence the determined by default.

[0077] Preferably, however, the app is programmed to permit the user either to accept the default setting or to select a different check-in interval, either permanently until the check-in interval is reset, or in respect of a specific event, function or venue for example.

[0078] In the example illustrated, the app is programmed to provide a drop-down list of pre-set check-in intervals from which the user may select and set such a different check-in interval. If no check-in interval is selected, the app defaults to the first interval displayed in the drop-down list as the default check-in interval.

[0079] Clicking on the “add event” button at the bottom of the “add event” screen records the event on the system.

[0080] In addition, it brings up a "live check-in” screen (right-most screen above).

[0081] When the participating user is ready to depart to the event, venue or activity, the user simply clicks on the “Start live check-in” button at the bottom of the "live check-in” screen to commence tracking and observer monitoring.

[0082] During live check-in, on completion of each check-in period, the user is prompted to enter the user's PIN, for example by means of the silent vibration alert and display of the PIN pop-up described above. If the user fails to enter the user’s PIN either immediately or within a pre-set entry period (anything between 10 and 20 seconds), the app initiates the appropriate emergency action, typically by raising an alarm on the observer devices and by displaying an alert/alarm activator on the user's device which, conveniently, could be a pop-up or button to enable the user to raise an appropriate alarm. [0083] Instead of being time-based, the check-in intervals could be location-based, such as waypoints along the user’s intended travel route that the user might enter on the user's app. As the user travels past each waypoint, the app is programmed to prompt the user to enter the user's PIN, failing which an alarm is raised.

Participating User Tracking

[0084] Activating the live check-in function activates the tracking function that allows the observer network to monitor the participating user’s progress towards the event, venue or activity and, if appropriate, the user’s participation and safety status during the course of travel or during the course of the activity. The left-most and right-most screens illustrated above are essentially home screens. The screens illustrated are screenshots taken from the participating user’s app display screens. Observers get to observe similar home screens that convey similar information, but then referring to the participating user in the third person rather than referring to the participating user as "you”.

[0085] The home screens illustrate the participating user’s geographic location as a map marker icon on a map that displays the route of travel (in the event that the activity involves travel) and the current location, constantly updated, of the participating user on the displayed map. In the event that the participating user enters the user's PIN upon the expiry or achievement of each check-in interval the system and app are programmed to deal with the live check-ins as regular (not out of the ordinary) and to treat the participating user’s safety status as safe. As a result, the user’s status is displayed as "Green". The check-in function is live and occurs in real time, with user location and live check-ins streamed in real time to the cloud to enable observers to observe, in real time, the participating user’s status and/or the user’s progress or otherwise towards the intended destination. In addition, the user and observers are able to discern the number of observers/guardians monitoring the participating user’s progress.

[0086] The app conveniently includes a training mode for participating users who wish to engage in training runs or walks. This is a variation of the live check-in function, in which the user must pre-program check-in intervals. During training, for example while the user is on a training run, the user is required to enter the user's PIN, when prompted, at each check-in interval. If this is not done, the app raises an alarm.

[0087] The app is programmed to provide a so-called dead man's trigger mode. This is a mode in which the app is programmed to display a button on the user's mobile device GUI that requires constant user touch on the button to keep the button deactivated. In the event that the user releases the user’s touch on the button, the button is automatically activated and an alarm is raised. If, for example, the user is on a training run and the user is attacked, the user need merely release the dead man’s trigger button to raise an alert that alerts observers that the user is in trouble at the user’s current location, as displayed on the display screens of the observer devices. In the preferred embodiment of this form of the invention, the dead man’s trigger is preferably programmed to raise an alert only if the user fails to enter the user’s PIN within a predetermined period of time after the button is released. The PIN entry period should preferably be relatively short, for example anything between 10 and 20 seconds.

[0088] The home screens include alert/alarm activators in the form of virtual buttons displayed on the home screens that enable the participating user to raise an alert or alarm.

[0089] On the Green (safe) home screen, the alert buttons include an “Amber Alert” that the participating user can simply click on to activate an Amber alert, and an “SOS” button that the user must slide across the mobile device display screen to activate an SOS.

Amber Alert Mode

[0090] With the app in Amber alert, the app actuates the mobile device GNSS, the mobile device microphone and audio recording automatically. In addition, the app sends an Amber alert notification to the observer network, who are able to track the location of the participating user and hear the audio picked up by the mobile device microphone.

[0091] The participating user can deactivate the Amber alert on the Amber alert screen (centre screen above). As an alternative, the Amber alert also changes the home screen to that illustrated in the right-most screen above by changing the background colour from green to yellow and by changing the Amber alert button to a "Go Green” button. This provides the participating user with an alternative mechanism to deactivate the Amber alert. SOS Mode

[0092] Both home screens (Green/sofe and Amber alert home screens) include an “SOS" button that the user can use to activate an SOS by means of which the participating user may alert the observer network of potential escalation of the alarm situation anticipated or experienced by the participating user. At any time when the participating user encounters a dangerous situation — and not only when the user wishes to escalate from an Amber alert, the user can activate an SOS mode by sliding the SOS slider button across the mobile device display screen.

[0093] In SOS mode, the app, as in Amber mode, actuates the mobile device GNSS, the mobile device microphone and audio recording, all automatically. In addition, the app activates the front and rear cameras of the mobile device such that, together with live audio, live video of the participating user's situation is streamed to the observer network.

[0094] The app sends an SOS alert notification to the observer network, who are able to track the location of the participating user and view the live video stream by the participating user’s mobile device.

[0095] The participating user can deactivate the SOS alert on the SOS alert screen.

[0096] The SOS alert also changes the home screen to an SOS home screen, which is illustrated in the screenshot above, by minimising the map display and using the major proportion of the screen to display live video. In addition, the background colour is changed to red.

[0097] The SOS home screen includes a pair of slider buttons, the first being a slider button that can be used to deactivate the SOS alert should the user’s safety situation improve. Actuation, by sliding, of the second, lowermost slider button activates a Blue Light mode, which is described below.

[0098] In both Amber and SOS modes, GNSS tracking is switched on, together with live audio streaming and recording and live video streaming (in SOS mode only). In this regard, GNSS tracking is switched on regardless of whether or not the participating user had previously selected GNSS tracking when activating the live check-in function.

[0099] The GNSS function and the audio and video streaming functions are switched on automatically because the participating user might not be in a position to switch on any of these functions and if the participating user were to be seen switching on these functions, it might expose the participating user to victimisation and possible violence. Blue Light Mode

[00100] With the app in SOS mode, the participating user is able to activate a Blue Light mode.

[00101] Activation of the Blue Light mode transmits an alarm call, a preprogrammed message or the user’s custom message to an emergency service provider, together with the participating user's location.

[00102] The SOS and Blue Light modes constitute emergency management functions forming part of the participating user module.

[00103] In certain implementations of the app, the observer module may be programmed to include SOS and Blue Light modes as part of the emergency management functions forming part of the observer module of the app. In such implementations, the observer module may be programmed to display SOS mode and Blue Light mode slider activators on the observer module home screens. This will enable observers to activate the SOS and Blue Light modes, respectively, on the participating user’s mobile device.

[00104] In one embodiment of the invention, the Blue Light mode is programmed simply to notify security and emergency service providers of the emergency or potential emergency as well as the participating user’s then current location. This is to enable such service providers to respond in the normal course of their duties.

[00105] In a developed form of the app, the service provider module may be programmed to enable registration of specified emergency and security service providers as registered users of the app. In this embodiment, the service provider is essentially contracted in by the participating user, even if only by acceptance of the user’s invitation. In most cases, however, the service provider will be a previously contracted-in service provider under a separate agreement with the participating user, such as a security company contracted to provide the participating user with security services or a medical rescue company or an emergency medical service provider associated with the participating user’s medical aid, for example.

[00106] In each case, the service providers are registered as service providers associated with the participating user, the service provider registrations being programmatically linked to the participating user's registration on the system.

[00107] The participating user will invite such service providers to download and register the app on the service providers' mobile devices for these service providers to be alerted and if necessary to attend to the participating user on site at the participating user’s current location as and when the participating user activates Blue light mode on the user’s app.

Blue Light Mode - Reporting Case

[00108] In the event that Blue Light mode is activated, the app is programmed to require the participating user to submit a case report, using the case reporting function constituted by the “submit case" screen illustrated above.

[00109] The case reporting function is programmed to solicit information pertaining to the service request, including the emergency giving rise to the service, the request, and the manner in which the service provider responds to the service request. A camera activation button is also provided, both os o reminder and to enable the participating user to take photographs and videos of the scene of the emergency.

[00110] This information is stored in the back-end administration system and on the participating user’s mobile device for purposes of assisting the participating user to prepare the appropriate police and insurance reports, details of which (such as police docket number and insurance claim number) may also be stored on the personal observer system, both on the mobile device and in the back-end system.

Alerts

[00111] The alerts programmed into the app operate similarly for the various modes and user types, the mobile device being programmed by the app to provide the user with an actuator incorporated in the mobile device.

[00112] The actuator may be a repurposed button of the mobile device, but on smartphones, the device is preferably programmed to present a virtual actuator on the GUI that the user may tap or swipe across the mobile device display screen to actuate.

[00113] The immediate emergency action initiated by the mobile device is a mobile device signal emitted or transmitted by the mobile device. The signal could be a flashing light alert or a sound generated by or by means of the mobile device. This would be appropriate for some emergency situations but not all. Emergency situations that involve a human antagonist as the cause of the emergency situation call for the emergency action to be unobtrusive and executed in the background without the antagonist realising. A conspicuous signal would be inappropriate in situations like this and might serve, at worst, to exacerbate the emergency situation or, at best, provide the antagonist with an opportunity to terminate the mobile device emergency action.

[00114] For this reason, the emergency actions initiated by the mobile device in Amber mode, SOS mode and Blue Light mode in particular are constituted by unobtrusive actions executed automatically by the mobile device, such as automatically switching on live audio and video streaming, without giving any indication that streaming has been switched on.

[00115] The same principles apply to the emergency actions constituted by the alerts and messages transmitted by the mobile device when in Amber alert mode, SOS mode and Blue Light mode. The alerts are transmitted silently and in the background to the observers and service providers, respectively.

[00116] In one embodiment of the invention, the participating user module includes program code by means of which the mobile device is programmed to generate an emergency action automatically in certain situations. In this embodiment, the mobile device is programmed to monitor for the occurrence of one or more predetermined parameters and to generate the emergency action automatically in the event that the monitored parameter eventuates.

[00117] One such monitored parameter could be sound in the immediate vicinity of the mobile device, using a smartphone as an exemplary mobile device. In this example, the smartphone could be programmed, for example, to maintain the microphone live (switched on) and to monitor for a predetermined sound. As an example, the sound could be a pre-trained word, phrase or sound made by the participating user. The sound will be selected to sound innocuous to an antagonist, but the device is programmed to recognise the sound and to initiate an emergency action if the sound is picked up by the smartphone microphone.

[00118] With the increasing sophistication of the environmental monitoring facilities of smartphones, including sophisticated microphones, cameras and accelerometers, as well as the everdeveloping capabilities of artificial intelligence (Al) software it is not inconceivable for the mobile device to monitor one or more of the participating user’s physical demeanour, including posture, movements and tone of voice and to generate an emergency service automatically in the event that an abnormal demeanour is detected, which might indicate rising user alarm or total user passivity, for instance, possibly indicating that the user has been drugged.

Companion Module

[00119] In the preferred form of the invention, the app includes a companion module by means of which the participating user can invite a companion to register on the app, with the companion registration creating an association on the system between the participating user and the companion. As indicated above, a companion is a person who accompanies the participating user to an event, such as a date or blind date.

[00120] To implement the companion module, the participating user uses the “Date Night" screen illustrated above to generate an invitation that is sent to the mobile device of the intended companion. The invitation includes functionality to specify an event and the venue, time and duration of the event, along with travel arrangements and times of travel to and from the event, if appropriate. On the intended companion’s mobile device, the invitation displays those details on the companion’s mobile device and it also displays a button that the companion can activate either to accept or reject the invitation.

[00121] When the companion accepts the participating user's invitation, the system creates a companion association between the user and the companion for the duration of the event and travel time, if selected. The companion association is displayed in the app on the mobile devices of the participating user and the companion as well as in the apps on observers’ mobile devices.

[00122] When the participating user and the companion get together for the event, the system tracks the geographic location of both mobile devices as the event progresses, which locations are displayed in real time in the apps of the participating user, the companion and the observers.

[00123] It will be appreciated that the system also creates a record of the companion association and the progression of the participating user and companion through the event. This information is stored in the back- end system and the participating user’s mobile device.

Service Provider Module

[00124] In yet a further form of the invention, the app includes a service provider module that appears and functions similarly to the companion module.

[00125] Using the service provider module, the participating user can invite one or more service providers to register on the app. The service provider registration creates an association on the system between the participating user and the service provider.

[00126] As indicated above, a service provider is a person or entity who provides the participating user with a service. Services might include the emergency security and medical services described above with reference to the Blue Light mode of the app. These services can be characterised as assistance services and are inherently non-risky. Certain services, however, carry an element of personal risk to participating users. One such potentially risky service is ride hailing, such as the well- known Uber™ ride hailing service.

[00127] Using the service provider module, much like the companion module described above, the participating user can invite and register the service provider on the participating user's app.

[00128] To do this, the participating user generates an invitation that is sent to the mobile device of the intended service provider. The invitation includes functionality to specify the service (such as an Uber™ ride) and details pertaining to the service (such as the time, duration and intended route of travel of the Uber™ ride). [00129] On the service provider’s mobile device, the invitation displays those details on the service provider’s mobile device along with a button that the service provider can activate to accept the invitation.

[00130] When the service provider accepts the participating user’s invitation, the system creates a service provider association between the user and the service provider for the duration of the service (for example the Uber™ ride).

[00131] During the course of the provision of the service, the system tracks the geographic location of both mobile devices as the service progresses, which locations are displayed in real time in the apps of the participating user, the service provider and the observers.

[00132] It will be appreciated that the system also creates a record of the service and service provider association and the progress of the service, which information is stored in the back-end system and the participating user’s mobile device.

[00133] One of the unique features of the system and the app forming part of the system is that users are provided with a substantial degree of control over their privacy.

[00134] In this regard, users are able to control user tracking and location sharing directly on the app and also to control and manage observer attendance. In particular, users are able to manage observer attendance by inviting or selecting specified observers to attend as observers for particular periods of time or in respect of specified events.

[00135] In addition, users are able to switch observer attendance on or off, even during the course of observation, for example by selecting specified observers to attend during travel to an event and by deselecting one or more of the specified to attend during the event or even by selecting a new set of observers for the duration of the event. It is of course also possible to program the app such that certain observers cannot be deselected, such as parents of children where the child will be disallowed from deselecting the parent as an observer.

[00136] Examples of a newer version of the app of the invention are described below with reference to diagrams constituted by screenshots illustrating individual smartphone display screens of a current prototype of the app and in which the observers are referred to as "guardians”.

[00137] Once registration has been completed, users will be presented with a home screen displaying the various modes as icons which the user can activate by selection. The modes which can be selected include a green alert mode, amber alert mode, red alert mode, blue alert mode and a dead-man trigger. Other features of the app are accessible by selecting the menu button.

Adding Guardians

[00138] Once the participating user has registered their user profile on the app, the app prompts the user to add one or more observers or guardians. These are trusted contacts who will be notified and updated of the participating user's geographical location and safety status in real time in use.

[00139] Guardians are selected from trusted contacts, whose contact details could be (but need not necessarily be) in the participating user’s list of contacts on the participating user’s mobile device. Guardians can also be added manually by filling in the requested details (image above).

Green Alert Mode

[00140] The default setting mode for the app upon registration is the Green Alert Mode which indicates that the user’s safety status is safe. The user is able to activate another mode at any time either by shaking the mobile device or by selection of one of the icons displayed on the side of the screen. Amber Alert Mode

[00141] The amber alert mode can be triggered by shaking the mobile device or by selection of the yellow microphone icon on the user’s home screen when the user is in a potentially unsafe situation.

[00142] Once the amber alert mode has been activated, live location tracking and audio streaming to a secure cloud is triggered.

[00143] The participating user can deactivate the amber alert mode on the amber alert screen either by selecting the green shield icon, thereby reactivating the green alert mode, when the user is safe or selecting the red camera icon, thereby activating the red alert mode, when the user is in a situation of escalated danger. Red Alert Mode

[00144] At any time when the participating user encounters a dangerous situation — and not only when the user wishes to escalate from the amber alert mode, the user can activate the red alert mode by selecting the red camera icon. In this mode, the app automatically notifies the user's pre-assigned guardians and shares the user's live location and current situation through live video streaming, which is simultaneously uploaded onto the secure cloud.

[00145] The participating user can deactivate the red alert mode on the red alert screen either by selecting the green shield icon, thereby reactivating the green alert mode, when the user is safe or selecting the blue light icon, thereby activating the blue alert mode, when the user is in a situation requiring the assistance of emergency personnel. Blue Alert Mode

[00146] The activation of blue alert mode, either by selection of the blue light icon displayed on the screen or an automatic activation by the app, triggers live streaming of the participating user's situation. The app then directs emergency personnel to be dispatched in response to the user's particular situation as determined by the live stream video. In one example where the user has been a victim of a contact crime, emergency private security services are dispatched. In another example where the user has been in a car accident, emergency ambulance services are dispatched. Any recorded live streaming and audio is uploaded to the secure cloud.

Check-in Alert Mode

[00147] The live check-in mode programmed into the app creates repeating check-in intervals at which the user is prompted to check into the app. In the preferred form of this embodiment of the invention, the user checks into the app by entering a previously programmed (by the user) Personal Identification Number (PIN). The use of prompt may be a silent vibration combined with a PIN pop-up, the app being programmed to display a PIN pop-up onto the device GUI into which the user is required to enter the PIN to complete live check-in.

[00148] The silent vibration enables the user to check-in discreetly if discretion is required.

[00149] During live check-in, on completion of each check-in period, the user is prompted to enter the user’s PIN, for example by means of the silent vibration alert and display of the PIN pop-up. If the user fails to enter the user’s PIN either immediately or within a pre-set entry period (anything between 10 and 20 seconds) , the app initiates the appropriate emergency action, typically by raising an alarm on the observer devices and by displaying an alert/alarm activator on the user’s device which, conveniently, could be a pop-up or button to enable the user to raise an appropriate alarm.

Dead-man Alert Mode

[00150] The app is further programmed to provide a so-called deadman trigger mode. This is a mode in which the app is programmed to display a button on the participating user's mobile device GUI that requires constant user touch on the button to keep the button deactivated. In the event that the user releases the user’s touch on the button, a countdown period is automatically triggered. If the participating user fails to enter the user’s PIN, or enters an incorrect PIN, during the countdown period after the button is released then the blue alert mode is automatically activated. The countdown period should preferably be relatively short, for example anything between 10 and 20 seconds.

Travel/Train Safe Mode

[00151] In this mode, the app can be programmed to watch over the participating user while traveling between locations, whether in a vehicle, on a bicycle or on foot, such as when the user is on a training ride or run. Once selected, the participating user inputs the intended destination, the planned travel route and an estimated time of arrival. When there is a predetermined deviation from the participating user’s specified route of travel or from the travel time specified, the participating user is prompted to enter the user PIN to indicate the user's safety status. If the participating user does not enter the PIN or enters an incorrect PIN either immediately or within a pre-set entry period (anything between 10 and 20 seconds), the blue alert mode will automatically be activated such that the appropriate emergency service can be dispatched.

The Vault

[00152] All audio and video recordings made through the app stored on a secure cloud for purposes of assisting the participating user to prepare appropriate police and insurance reports when a case is opened, details of which (such as police docket number and insurance claim number) may also be stored on the personal observer system, both on the mobile device and in the back-end system. The information is only accessible for viewing and listening from a secure storage facility of the app referred to as the “vault", which prohibits any of the information from being downloaded and edited. When audio and video information from the vault is required as evidence for a case by the participating user, the user has to make an authorised request.

Membership

[00153] The app enables a participating user to become a paying user through the participating user linking a user bank card to the app. Alternatively, the participating user can load a prepaid voucher to the app by entering a voucher code.

Panic Button

[00154] In another embodiment, the invention includes independent electronic device in the form of a panic button having a separate SIM card and GPS. When the panic button is triggered, emergency services and the participating user's guardians are alerted. The panic button can also be linked to the app.

Claims

Claims . A personal observer system comprising: a plurality of participating location-aware, communications- enabled mobile devices each including programmable logic means, an interactive user interface, audiovisual capture and display means, and geospatial functionality; and a computer software application (“app”) comprising computer program code configured for downloading, installation and implementation in the mobile devices, the app comprising at least a participating user module and an observer module, in respect of which: the participating user module is programmed for installation in a participating user’s mobile device and, upon installation in the participating user mobile device, programs the mobile device programmable logic means to implement a participating user mode in which the mobile device functions as a participating user mobile device programmed to implement a predetermined participating user registration function, an observer registration function, a participating user tracking function, a geospatial function and an emergency management function; the observer module is programmed for installation in an observer’s mobile device and, upon installation in the participating user mobile device, programs the mobile device programmable logic means to implement an observer mode in which the mobile device functions as an observer mobile device programmed to implement a predetermined observer registration function, a participating user tracking function, a geospatial function, and an emergency management function, in which: the participating user registration function includes means to enable registration of a prospective user as a participating user and the participating user mobile device as a participating user device on the personal observer system; the observer registration function includes means to enable registration of the observer and the observer mobile device as an observer device on the personal observer system; the participating user tracking and geospatial functions include means to enable geospatial location of the participating user mobile device and the display of geospatial data pertaining to the current geographic location of the participating user mobile device on the visual display means of the participating user and observer mobile devices; and the emergency management function includes, on both the participating user and observer devices, means to enable either or both the participating user or observer mobile devices to generate an emergency action and, on the participating user device, means to generate an emergency action automatically in dependence on at least one sensed parameter; each of the means to enable registration, geospatial location, the display of geospatial data and the means to enable generation of an emergency action being implemented in the mobile devices by the participating user and observer modules including programs that program each mobile device to produce appropriate interactive displays and interaction prompts on the mobile device interactive interface. The personal observer system of claim 1 , in which the mobile devices include, as an interactive interface, a graphical user interface (GUI), the mobile device being programmed to implement the geospatial function by displaying the geospatial data pertaining to the participating user mobile device as a map display on the GUI of the participating user and observer mobile devices, respectively. The personal observer system of claim 2, in which the mobile device is programmed for the interface to display the location of the participating user mobile device as an icon or marker on a geographic map displayed on the GUI, with the map marker icon being located at a displayed map location corresponding to the actual geographic location of participating user mobile device. The personal observer system of any one of the preceding claims, in which the app includes a service provider module programmed for installation in a service provider’s mobile device and, upon installation in the service provider mobile device, to program the mobile device programmable logic means to implement a service provider mode in which the mobile device functions os o service provider mobile device programmed to implement a predetermined service provider registration function, a participating user and service provider tracking function, geospatial and emergency management functions. The personal observer system of any one of the preceding claims, in which the emergency action forming part of the emergency management function includes, in respect of both the participating user and observer mobile devices, programmable logic means programmed to initiate an emergency action on either or both the participating user and observer mobile devices, the emergency management function including: in respect of the participating user mobile device, program code forming part of the participating user module that programs the mobile device to initiate an emergency action automatically in dependence on at least one sensed parameter; and in respect of both the participating user and observer mobile devices, program code forming part of the participating user and observer modules that, in each case, programs the mobile device to prompt one or more of the participating user and the observer, by way of the mobile device interface, to initiate the emergency action.

The personal observer system of claim 5, in which the program code programs the mobile device to prompt the participating user or observer to actuate an actuator incorporated in the mobile device. . The personal observer system of any one of the preceding claims, in which the emergency action initiated by the mobile device is constituted by an alarm signal transmitted by the mobile device. . The personal observer system of claim 7, in which the program code programs the mobile device to transmit the alarm signal to an emergency service provider and in which the alarm signal includes data pertaining to the participating user’s current geographic location. . The personal observer system of any of claims 5 to 8, in which the means to generate an emergency action comprises program code that forms part of the participating user module program code and that programs the mobile device to monitor for the occurrence of one or more predetermined parameters and to generate an emergency action automatically in the event that the monitored parameter eventuates. . The personal observer system of claim 9, in which the monitored parameter is a deviation from the participating user’s specified route of travel. The personal observer system of claim 9, in which the monitored parameter is a deviation from the participating user’s specified travel time. The personal observer system of claim 9, in which the monitored parameter is a specific sound. The personal observer system of claim 9, in which the monitored parameter is a predetermined change in the participating user’s physical demeanour. The personal observer system of any one of claims 10 or 1 1 , in which the participating user module is programmed to prompt the participating user to indicate the user’s safety status upon the occurrence of a predetermined deviation from one or more of the participating user’s specified route of travel or travel time. The personal observer system of any one of the preceding claims, in which the mobile device programmable logic means is programmed, upon initiation of an emergency action, to activate the audiovisual functions of the mobile device to capture audiovisual data in the form of one or more of audio and video recordings. The personal observer system of any one of the preceding claims, in which the mobile device programmable logic means is programmed to initiate an emergency action when the mobile device is shaken. The personal observer system of any one of the preceding claims, in which the mobile device programmable logic means is programmed to display a button on the mobile device user interface, the mobile device being programmed to initiate an emergency action in the event that the user fails to maintain constant user touch of the button for a predetermined time.