AU2002229403B2 - Analysis of business innovation potential - Google Patents

Description

WO 02/063510 PCT/AU02/00111 Analysis of Business Innovation Potential This invention relates to a method of determining a measure of a business's potential for innovation as an aid to business management and as a measure of a business's potential to achieve a high return on investment from the business.

Background to the invention Analysis of business risk and predicting the likelihood of a business performing in the future are difficult tasks that are increasingly in demand by investors and business managers.

W098/20438 discloses a needs analysis computer system which consists of a program providing questions with yes no answers, a program providing appropriate responses to the answers and means to select a degree of importance of each response the selections being stored in memory and an output of proposed actions being provided at the conclusion of the program. This program is suitable for small business assistance but does not predict future performance.

WO0011671 discloses a system of matching entrepeneurs with investors using a communication network and includes data to enable investors to assess the entrepeneur.

W00034911 discloses a system for depicting the effect of business decisions on market value. The system classifies assets into tangible and intangible asset categories and models market value as a function of these categories.

W00068861 discloses a benchmarking analysis system in which a benchmark provider receives appropriate data from number of suppliers and then the data is analyzed on a weighted basis keyed to the suppliers status in the industry and then compared to the industry averages. The supply of the data and the benchmark report at regular intervals aids business decision making.

W00073945 discloses a method for making a loan based on an intangible asset such as intellectual property. This enables a lender to assess the value and liquidity of the intangible asset.

These recent developments do touch on the importance of intellectual capital but do not measure the performance of the process that produces intellectual capital.

Innovation has come to be seen as essential to a business using its intellectual capital to develop new products, processes and designs to achieve growth in sales WO 02/063510 PCT/AU02/00111 2 and achieve and maintain a high rate of return on investment [ROI]. The process of innovation and the key factors for successful innovation are becoming better understood but the implementation and management of innovation policies are difficult.

What is needed is a means of evaluating innovation performance so that progress can be tracked over time. Such a measure should not only be useful for managers wanting to benchmark and improve their performance but also for investors to use as a guide in comparing a company to its competitors and in predicting future io earnings and ROI.

It is an object of this invention to provide a measure of innovation capability.

Brief Description of the Invention To this end the present invention provides for use with a computer or a computer network, a system of measuring innovation capability for use in managing a business or assessing valuation of a business consisting of a) a survey questionnaire to be completed by a plurality of personnel in the business in which groups of questions correlate with one or more of a multiplicity of factors related to innovation capability b) an answer database for storing and assembling answers to the questionnaire and creating a value for each answer c) optionally, a recommendation database of recommendations for improving performance based on existing factor scores d) a first algorithm for converting the sum of the answer values to each question into a score e) a second algorithm for summing the scores for answers in each group into a score for each innovation factor f) a third algorithm for summing the scores of all the factors into a value index which is indicative of the business's potential return on investment g) a display program for presenting the values for each factor and the value index h) and optionally a program utilising the factor scores and the value index for generating from said recommendation database, recommendations to management for improving the innovation capability of the business.

WO 02/063510 PCT/AU02/00111 3 Preferably the system utilises the internet and questionnaires are answered on line. The system may be used to diagnose the innovation capabilities of a business and to improve the innovation performance by generating a prioritised set of recommendations based on an analysis of the answers and the factor scores.

The subject of the questions constituting each innovation factor are key indicators of the effectiveness of the organisation in the factor. When all factors are resourced adequately and managed effectively the organisation optimises the io application of assets applied to innovation. The performance of an organisation at innovation is dependent on the effective utilisation of resources devoted to innovation plus the effective utilisation of resources used to manage all other processes and relations within the organisation.

Preferably the first algorithm weighs the answer values of selected questions and Is calculates the mean and median scores for all questions.

The second algorithm preferably sums the weighted mean scores for questions associated with each factor into a score for that factor Detailed description of the invention This invention uses a generic open system model of business organisations which evaluates the six capabilities which are here called the foundation capabilities: 1. General management, which integrates the other five factors 2. Strategy for the business and competitive strategy 3. Environmental scanning 4. Marketing and sales Production/operations 6. Administration including finance IT and human resources.

These capabilities overlap with each other but also operate in dynamic tension because in some situations they have differing and even opposing purposes. As conventionally practised, these capabilities do not necessarily involve innovation and may even be used to prevent innovation. Businesses That score well on these six capabilities do not necessarily grow and achieve above average ROI.

Business growth derives from the creation of value through the development of new products or methods and new business designs which are generally a result WO 02/063510 PCT/AU02/00111 4 of purposeful innovation. To predict future earning potential it is necessary to have an assessment of a business's innovation potential. Innovation potential depends on how well the innovation capabilities are developed and managed.

This invention is partly predicated on the realisation that innovation capabilities are essentially subsets of the foundation capabilities. The six innovation capabilities are 1. Leadership 2. Innovation strategy 3. Fosterinq innovation via the external environment which involves the purposeful use of external data, relations and networks as sources of ideas and innovation.

4. Internal environment for innovation. The job designs, organisational structure,decision making and reward systems that foster creative thinking and problem solving while also providing the framework for routine work processes.

The innovation production process which is essentially create, capture, assess, apply. This is the process of idea generation and application which can be in conflict with the firm's production process because production focuses on efficiency and innovation focuses on adaptation 6. Maintenance and measurement of innovation In the context of businesses and organisations understood as open systems the six innovation capabilities are in "natural" conflict or creative tension with the six foundation capabilities.

The utilisation of resources for the foundation and innovation capabilities gives an insight into the potential of a business to generate earnings growth and above average ROI.

The preferred algorithm for determining the value index V is: V=I R/100[wl +w2+w3+w4+w5+w6] F R/1 00[W1 +W2+W3+W4+W5+W6] P[Revenue/Market capitalisation] Where: The optionally additional component P[Revenue/Market capitalisation] is a measure of the impact of innovative business system designs on the performance of a business as such designs can have a dramatic impact on ROI. P is a number between 1 and 5 derived from data collected from the business.

WO 02/063510 PCT/AU02/00111 w1,2,3,4,5,6 and W1,2,3,4,5,6 are the innovation and foundation capabilities expressed as a weighted percentage representing the effectiveness and impact of resource utilisation for the respective capability and is derived from the weighted average of a set of questions in the survey questionnaire.

For foundation capabilities the weightings are W1 Management W2 Strategy W3 Environmental Scanning W4 Marketing Production W6 Administration For Innovation capabilities the weightings are wl leadership w2 strategy w3 scanning w4 internal environment innovation process w6 measurement I R is the of resources devoted to innovation and is based on R D expenditure and estimates of expenditure on other specified types of innovation derived fro the answers to the audit including time devoted to innovation.

F R is the of resources allocated to foundation activities And IR FR =100 Additional weights Y and Z [which have empirically determined values between 1 and 10] may be added to the wl and W1 factor weights to take account of the relatively high impact of leadership and management as a result of these functions having a coordinating and integrating role in relation to all other functions and extraordinary effects such as the effect of CEO departure on stock prices.

The value index measurement can be assessed at intervals of 6months or more to give an overall view of the progress of the business.

The value index can also be used to forecast Innovation Potential Rank [IPR] which is an indicator of performance two years from the time of measurement. The WO 02/063510 PCT/AU02/00111 6 forecast algorithm is based on the fact that companies that currently apply more resources to innovation than their competitors and better manage the resources they apply will, with the exception of extraordinary events outperform their s competitors in the medium term.

In order to create a score for each innovation factor and each foundation factor answers to sets of questions relating to each factor are scored and financial and other data on the business being measured are collected.

Indicative questions for each factor are given below. These questions are written lo for senior managers. Other questions are written so that they can be answered by any employee. Most questions are phrased as statements that respondents rate on a scale.

SAMPLE QUESTIONS MANAGEMENT FACTOR Both successful and unsuccessful projects are reviewed. Reviews focus on lessons that can be learned and insights gained Across the company there is excellent communication between technical/R D personnel and commercial/marketing personnel Managers in our company know how to set up, lead and maintain effective teams LEADERSHIP FACTOR Managers, from the top down, draw employees' attention to the value of ideas, creative thinking and innovation by what they say and what they do This company has enough people with the qualities required to lead innovative projects and ventures. making things happen, handling ambiguity and uncertainty, building stakeholder support) STRATEGY FACTOR Our managers agree on the major opportunities, threats and constraints facing the company in the next few years Our managers know what our competitive advantage is and also how our core competencies underpin that advantage STRATEGY FOR INNOVATION FACTOR Our company's vision, value and strategy documents set out clear demands and opportunity areas for innovative thinking and action (e.g.

creating new customers, markets, products, services, ventures or alliances) WO 02/063510 PCT/AU02/00111 People in our company know what its main sources of growth will be in the next few years and use this knowledge to develop and assess innovative business cases/investment proposals EXTERAL SCANNING FACTOR Our managers know how to assess the impacts of trends and discontinuities beyond the immediate industry environment long term technological, social trends) Our managers and supervisors tell staff about external trends and developments (opportunities and threats) and also engage them in thinking about responses.

EXTERNAL ENVIRONMENT FOR INNOVATION FACTOR The company has leading edge customers and suppliers and works with them in value creating partnerships The company actively monitors the products, services and strategies of competitors with a view to imitating and/or bettering them MARKETING FACTOR Rate the quality and effectiveness of brand building and management Rate the quality and effectiveness of marketing and sales strategies, plans and programs INTERNAL ENVIRONMENT FACTOR Our organisational structure (reporting relations, roles, authorities, delegations) allows and encourages individuals and teams to take initiative and to try out new ideas The company actively recognises people who find and apply valuable innovative ideas.

PRODUCTION/OPERATIONS FACTOR Quality thinking and practices are embedded in the company and help to maintain and improve its performance.

Rate the efficiency and responsiveness of production/operations CAPTURE, ASSESS, APPLY FACTOR Our company is know and respected for its research leadership The company knows how and where to facilitate breakthrough thinking Where I work there are effective ways of capturing ideas and suggestions I know how to use stories and metaphors to present novel ideas and proposals ADMINISTRATION FACTOR When I need to, I can get a rich supply of information on our products, processes, projects and performance WO 02/063510 PCT/AU02/00111 8 Only reviewed, high value materials go into our online knowledge system.

MEASUREMENT MAINTENANCE OF INNOVATION FACTOR The company is developing ways to measure the value of its intangible assets (brands, knowledge, intellectual capital, patents, etc.) Managers and staff in the areas of accounting, personnel and finance recognise and support the activities that foster innovation, even when additional or unusual demands are involved.

VALIDITY TESTING Eleven organisations, seven companies and five public sector organisations completed the WAVE audit.

The appropriate personnel senior executives and a cross section of middle managers completed the questionnaires. In some cases all personnel from a Division of a large organisation completed the audit.

One of the limitations of the research was the small sample only eleven organisations took part. Another unavoidable limitation arises from the fact that one of the audit questionnaires collects data only from senior executives, and there are typically a very small number of these between 4 and 20 in most companies and business units. Many statistical tests of significance require a moderate number of responses and the small number of responses, eg less than ten, limited the power of the tests in some cases.

CONTENT VALIDITY The conventional method for establishing content validity, ie that the instrument is measuring what it purports to measure is by literature reviews and research analysis. In the case of WAVE extensive reviews of existing instrument measuring quality and business excellence were conducted. The literature on innovation was also reviewed.

CONSTRUCT VALIDITY The first three hypotheses were aimed at establishing the construct validity of the instrument. The tests were aimed assessing whether expected relations between various parts of the models were confirmed by the data.

WO 02/063510 PCT/AU02/00111 9 The first hypothesis tested was that performance on innovation activities factors (V factors) would be lower than performance on the foundation factors (F factors).

The test was applied to all six factor scores on both Managers and Employees data.

The rationale for the hypothesis is that companies and organisations are better at designing and managing "Foundation" activities than "Innovation" activities because they have been doing it for much, much longer. The management of innovation, encompassing product, process, R D, and business design innovation is in its infancy, as a codified field of practice, and there are very few theories or models.

For the Managers data, many of the differences between F and V scores for the factors were significant, with V being significantly higher than F scores. There Is were only a few cases in which the reverse was true for some the companies on the External factor).

For the Employee data there were quite a few significant differences recorded, with F scores being superior to V scores for the majority of factors. There was one exception, as the mean V scores for the External factor tended to dominate over the F scores.

Nearly all cases in which the hypothesis was not confirmed related to the function "External Environment" the items (questions) in the instrument used to construct the External Environment" function were examined. The full description of this function is "Using sources of ideas and knowledge from the external environment, such as people in networks that are cultivated to stimulate creative and innovative concepts".

The second hypothesis was that the Managers would have higher scores on the six factors than Employees. The factor scores analyzed were the means of both V and F items for four of the six factors.

It was expected that senior managers would give more positive ratings of performance than their subordinates on most areas measured, especially in less well managed companies.

There was good support for the second hypothesis across three of the four factors.

WO 02/063510 PCT/AU02/00111 The unexpected findings on the "External environment" factor are explained by the comment made previously.

s The third hypothesis was that innovation performance over the past three years (question 2) would be lower than overall performance over the same period.

(Question It was expected that in most cases the management of innovation would not be as strong as overall management and performance.

This Hypothesis was supported in six of the eleven companies.

io When analysing the data in the context of knowledge of the companies, it became apparent that situational factors, such as a decline or very weak improvement in performance over the previous three years, would limit support for this hypothesis to companies where there had been moderate to high improvement in overall performance.

PREDICTIVE VALIDITY The fourth hypothesis was that Managers' expectation (question 3) of future performance based on innovation is correlated with the aggregate factor score for all of the V items, that is, the overall innovation capabilities across the company. A significant correlation indicates that there is a relationship between Managers' expectations of future performance and current innovation capabilities The correlations between current innovation and future performance ranged from moderate to high and were significant for seven companies. Small sample sizes meant that results for three other organisations were inconclusive.

The fifth hypothesis was that composite WAVE scores (called the Index) would indicate the future performance of profit based organisations. This hypothesis is the most important of all The key test of the accuracy of a measure is its relationship against an independent external measure. This hypotheses could only be measured some time after the data was collected. The results are shown in the tablel WO 02/063510 PCT/AU02/00111 TABLE 1 WAVE Audit Scores compared with actual performance one year later (Return on Total Assets) for 8 companies. Correlation 0.74 Return on Executive Company Foundation Innovation Foundation Innovation WAVE Assets Forecast Code Scores Scores Resources Resources INDEX 0/1 rat 00/01" Accurate? 1 64 51 0.95 0.05 6.34 1.6 Yes Sample 2 64.8 53 0.90 0.10 6.36 3.1 too small 3 67.5 54.5 0.95 0.05 6.69 9.9 Yes 4 70 57 0.95 0.05 6.94 5.9 Yes Sample 66 58 0.90 0.10 6.52 10.8 too small 6 67 56 0.95 0.05 6.65 11.5 Yes 7 73.5 67 0.80 0.20 7.22 12.6 Yes 8 75 60 0.90 0.10 7.35 14.7 Yes This table only includes profit based companies. Other organisations that took part in the research and were included in other statistical tests were government departments.

Financial data is taken from published sources. Australian Financial Review and Business Review Weekly and from information supplied when published data was not available.

The data collected was from both very large companies and medium sized autonomous business units of large companies involved in diverse industry sectors including power utilities, chemical processing, control instrumentation, l0 medical instruments, banking and telecommunications.

A highly simplified version of the algorithm was used to calculate the single figure index. The average of all foundation and all innovation factors were multiplied by an estimate of the resources applied to each. No weights or adjustments were applied.

The correlation of 0.74 obtained is considered high by statisticians.

WO 02/063510 PCT/AU02/00111 12 Despite the diverse industries and competitive conditions faced by the companies, and the simplified formula used, the WAVE measure for these companies has a strong relationship with financial performance.

From the above it can be seen that the present invention provides a unique system for assisting businesses to improve innovation performance and measure the performance in a way that is not only meaningful for managers but also for io investors.

Claims (3)

1. 2. A method as claimed in claim 1 in which the innovation capabilities are leadership, innovation strategy, fostering innovation, the internal environment of organisational structure and reward systems, the innovation production process and the maintenance and measurement of innovation.
2. 3. A method as claimed in claim 1 wherein the algorithm for the value index V is V=I R/100[wl+w2+w3+w4+w5+w6] F R/1 00[W1 +W2+W3+W4+W5+W6] Where wl,2,3,4,5,6 and W1,2,3,4,5,6 are the innovation and foundation capabilities expressed as a weighted percentage representing the effectiveness of resource utilisation for the respective capability and is derived from the weighted average of a set of questions in the survey questionnaire; I R is the of resources devoted to innovation and is based on R D N expenditure NPD expenditure; IF R is the of resources allocated to foundation activities O And IR FR =100.
3. 4. A system, of measuring innovation capability for use in managing a business oor assessing valuation of a business, conducted over a computer network which includes io a) an on line survey questionnaire to be completed by a plurality of personnel in Sthe business in which groups of questions correlate with one or more of a multiplicity of factors related to innovation capability b) an answer database located in a central processor for storing and assembling answers to the questionnaire and creating a value for each answer c) optionally a recommendation database of recommendations for improving performance based on existing factor scores d) a first algorithm in said central processor for converting the sum of the answer values to each question into a score e) a second algorithm in said central processor for summing the scores for answers in each group into a score for each innovation factor f) a third algorithm in said central processor for summing the scores of all the factors into a value index which is indicative of the business's potential return on investment g) a display programgenerated by said central processor for presenting the values for each factor and the value index h) and optionally a program in said central processor utilising the factor scores and the value index for generating from said recommendation database, recommendations to management for improving the innovation capability of the business. A system as claimed in claim 4 in which the innovation capabilities are leadership, innovation strategy, fostering innovation, the internal environment of organisational structure and reward systems, the innovation production process and the maintenance and measurement of innovation. 0 Cl 6. The system as defined in claim 4 wherein the algorithm for the value index V is o V=I R/100[wl +w2+w3+w4+w5+w6] F R/100[W1 +W2+W3+W4+W5+W6] O 5 Where w1,2,3,4,5,6 and W1,2,3,4,5,6 are the innovation and foundation capabilities expressed as a weighted percentage representing the effectiveness of resource o utilisation for the respective capability and is derived from the weighted average of a set of questions in the survey questionnaire; C 10o I R is the of resources devoted to innovation and is based on R D N C expenditure NPD expenditure; SF R is the of resources allocated to foundation activities And IR FR =100.