JP2014146264A - Restaurant evaluation system and restaurant evaluation program - Google Patents

Abstract

A restaurant evaluation system is configured so that objective evaluation information about a restaurant can be obtained.
The restaurant evaluation system includes a scoring process (S27) for scoring a dish based on a predetermined feature amount obtained from an image obtained by photographing a dish served at a restaurant, and a scene where a person eats the dish. A smile degree calculation process (S27) for calculating the smile level of a person's face based on the photographed image, and an evaluation point calculation process (S14) for calculating an evaluation score for the restaurant based on the scoring information and smile level information of the dish. ), Information indicating a restaurant, and a storage process (S15) for storing the evaluation score in association with each other, and a transmission process (S11) for transmitting the stored restaurant information to an external device when requested. To do.
[Selection] Figure 2

Description

  The present invention relates to a restaurant evaluation system and a restaurant evaluation program.

  A restaurant information providing system that provides restaurant information on the Internet is known. The user who has received the information browses the images and menus of the restaurant, and forms an impression of the restaurant based on the evaluation of the restaurant included in the posted articles such as so-called “word-of-mouth”. However, the posted evaluation includes the subjectivity of the contributor, and content that is intentionally contrary to the fact may be posted intentionally, so it is not objective from the viewpoint of a third party. Therefore, a restaurant rating system is known in which a rating given by a user to a restaurant can be browsed only by the user (see Patent Document 1).

Japanese Patent No. 4005342

  However, when a restaurant that has not been used in the past is used for the first time, there is a demand to refer to objective evaluation information by a third party.

  The restaurant evaluation system according to the present invention provides a scoring process for scoring a dish based on a predetermined feature value obtained from an image obtained by photographing a dish served at a restaurant, and an image obtained by photographing a scene where a person eats a dish. A smile degree calculation process for calculating a smile degree of a person's face based on the information, a score calculation process for calculating an evaluation score for the restaurant based on the scoring information and smile degree information of the food, information indicating the restaurant, A storage process for storing the evaluation points in association with each other and a transmission process for transmitting the stored restaurant information to the external device are executed as required.

  According to the present invention, objective evaluation information about a restaurant can be obtained.

It is a figure which illustrates the whole structure of a restaurant information provision system. It is a flowchart explaining the process sequence by the restaurant information provision system. It is a figure which illustrates the store list screen displayed on the display part of the user side terminal. It is a figure which illustrates the top screen of store introduction. It is a figure which illustrates the evaluation score with respect to a certain store. It is a figure explaining supply of the program to a user side terminal.

  Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating an overall configuration of a restaurant information providing system 10 including a restaurant evaluation system according to an embodiment of the present invention. In FIG. 1, a server 12, a PC 14, and a wireless LAN (Local Area Network) access point 18 are connected to a network 16.

  The restaurant information providing system 10 provides restaurant information on the net. The restaurant information to be provided is provided by the restaurant image, the cooking menu at the store, the map information of the store, posts from users using the store, and users using the store. The evaluation score for the restaurant store calculated based on the received information is included.

  A user who is provided with restaurant information accesses the server 12 constituting the dish evaluation apparatus via the multi-function mobile phone 20 such as a smartphone or the PC (personal computer) 14. The server 12 is installed in a data center or the like by an operator that provides restaurant information (hereinafter referred to as a provider).

  The server 12 includes a storage device including a database, a data processing device, a communication control device between the network 16, and the like, and manages data and the like necessary for providing restaurant information. Data managed by the server 12 is stored so as to be searchable. For example, “Tokyo”, “Shinbashi”, “Shinjuku”, “Shibuya”, etc., search by area where restaurants operate, or “Japanese”, “French”, “Italian”, etc. In addition, a search is made according to the genre of food provided at a restaurant. The contents of the restaurant data include “word-of-mouth” information and the above-mentioned “evaluation point” information in addition to the menu of the store and the map information indicating the location of the store.

  The access point 18 is installed in a station or commercial facility, and is called a hot spot. The user accesses the server 12 from the home or office via the PC 14 or accesses the server 12 via the access point 18 using a wireless LAN function such as a smartphone 20 or a tablet computer. Note that the server 20 on the network 16 may be accessed from the smartphone 20 via a mobile phone network (not shown).

  Since this embodiment has the characteristic in the calculation of the evaluation point with respect to the restaurant store which the said restaurant information provision system 10 provides, the following description is performed focusing on this point.

  The overall processing procedure by the restaurant information providing system 10 described above will be described with reference to the flowchart of FIG. In FIG. 2, the flow of processing by the server 12 is shown on the left side, and the flow of processing by the user side terminal (PC 14 or smartphone 20) is shown on the right side.

<Processing of user terminal 20>
In step S21, the user terminal 20 on which the browsing application has been activated transmits URL (Uniform Resource Locator) information of the server 12. When the restaurant information designated from the server 12 corresponding to the URL is transmitted to the user terminal 20, the user terminal 20 displays the restaurant information received in step S22 on the display unit of the user terminal 20. . Thereby, the user browses the restaurant information provided from the server 12.

  FIG. 3 is a diagram illustrating a store list screen displayed on the display unit of the user-side terminal 20. For example, the server 12 is configured to narrow down and provide information on restaurants recorded in the database for each area including the location of the restaurant or for each genre of food provided at the restaurant.

  When the area name in the window 44 is tapped on the user terminal 20, the server 12 transmits the list information of restaurants corresponding to the designated area to the user terminal 20. The user terminal 20 displays the received information in the store list display field 40 of the display unit. Further, when the genre name in the window 45 is tapped on the user side terminal 20, the server 12 transmits the restaurant list information corresponding to the instructed genre to the user side terminal 20. The user terminal 20 displays the received information in the store list display field 40 of the display unit.

  The restaurant information displayed in the store list display column 40 includes a store image 41, a store name 42 and its introduction article, and a representative menu introduction image 43. When the store name 42 in the store list display column 40 is tapped on the user side terminal 20, the server 12 transmits the instructed store introduction information to the user side terminal 20. The user terminal 20 displays a store introduction screen on the display unit based on the received information. FIG. 4 is a diagram illustrating a top screen for introducing a store. In FIG. 4, a store image is displayed in a window 51, and a “word of mouth” button 52 and a “view evaluation” button 53 are provided.

  In the upper part of the window 51, four tabs "Top", "Menu", "Map", and "Reservation" are provided. When any tab is tapped on the user side terminal 20, the server 12 transmits the corresponding information to the user side terminal 20. As a result, the user terminal 20 displays an image based on the received information in the window 51. For example, when the “menu” tab is tapped, a menu introduction image is displayed in the window 51, and when the “map” tab is tapped, a map image indicating the store location is displayed in the window 51. When the “reservation” tab is tapped, a reservation acceptance screen is displayed in the window 51.

  When the “word-of-mouth” button 52 is tapped on the user-side terminal 20, the server 12 transmits information on a “word-of-mouth” browsing window (not shown) to the user-side terminal 20. As a result, the user-side terminal 20 pops up a “word-of-mouth” browsing window based on the received information. The user can also post “word of mouth” information to the server 12 via the user terminal 20. The posting of the “word of mouth” information is the same as in the prior art, so the description is omitted.

  When the “view evaluation” button 53 is tapped on the user-side terminal 20, the server 12 transmits information on evaluation points for the store to the user-side terminal 20. The evaluation score is calculated in advance for each store and stored in the database. As a result, the user-side terminal 20 displays evaluation point information based on the received information on the display unit. FIG. 5 is a diagram illustrating a screen that displays an evaluation score for a certain store displayed on the display unit. In FIG. 5, “overall display” 61 indicating the distribution of evaluation points for all stores having restaurant information, and “display by area” 62 indicating the distribution of evaluation points for stores included in a predetermined area among all stores. “Display by genre” 63 indicating a distribution of evaluation points for stores corresponding to a predetermined genre (for example, Japanese food) among all stores, and a “return to store screen” button 64 are displayed.

  In “display by area” 62 and “display by genre” 63, the distribution graph of the entire store is superimposed and displayed on the background to easily compare the difference between the distribution in the specific area or specific genre and the distribution of the entire store. It is configured to be able to.

  In step S <b> 23 of FIG. 2, the user terminal 20 determines whether or not an evaluation application activation instruction has been issued. The evaluation application is a program for generating information necessary for calculating an evaluation score for a restaurant in the server 12 by the user terminal 20 and sending the information to the server 12.

  The user terminal 20 makes an affirmative decision in step S23 and proceeds to step S24 when an evaluation application activation operation (for example, a tap operation on an application activation icon not shown) is performed. When the evaluation terminal is not instructed to start the evaluation application (for example, when the “return to store screen” button 64 in FIG. 5 is tapped), the user terminal 20 makes a negative determination in step S23 and returns to step S21. . By returning to step S21, the store introduction top screen illustrated in FIG. 4 is displayed again on the display unit of the user side terminal 20.

  As described above, the evaluation point information for each store on which the evaluation point display screen illustrated in FIG. 5 is based is stored in the database on the server 12 side. Based on the information transmitted from the user-side terminal 20, the server 12 calculates an evaluation score by a procedure described later. The processing from step S24 to step S31 is processing for obtaining information transmitted from the user terminal 20 to the server 12.

  In step S24 of FIG. 2, the user terminal 20 performs an application startup process for evaluation, and proceeds to step S25. In step S25, the user terminal 20 performs moving image shooting (recording and recording), and proceeds to step S26. Thereby, a state where a user eats dinner at a restaurant store is recorded and recorded. The moving image includes the face of the person who is cooking or having dinner, and the recorded voice includes the conversation of the person who is having dinner. The user terminal 20 further acquires position information. The position information is acquired based on the radio wave from the GPS satellite if it is outdoors, and based on the radio wave from the access point 18 of the wireless LAN even when the radio wave from the GPS satellite cannot be received.

  In step S <b> 26, the user terminal 20 extracts (extracts) a frame image in which a dish is photographed and a frame image in which a person's face is photographed from among the frame images constituting the moving image. Proceed to S27.

  In step S27, the user terminal 20 performs image evaluation based on a predetermined feature amount obtained from the cut frame image. The user-side terminal 20 calculates the scoring value Q based on, for example, the color of the dish being photographed, the serving shape, the serving amount, and the degree of ingredient dispersion. For the calculation of the scoring value Q, the method described in JP 2010-61383 A can be used.

  The user terminal 20 further determines the smile degree M based on a frame image in which a person's face is captured. The degree of smile is divided into four levels, for example, 3 (big laughter), 2 (medium laughter), 1 (smile), and 0 (no smile). The detection of the face in the image and the determination of the smile level are well known and will not be described.

  In step S28, the user terminal 20 performs voice evaluation based on the voice of the person included in the recording data. The user side terminal 20 counts the number of appearances of the words “delicious”, “Uma”, and “delicious” in a predetermined time, and calculates the number N of appearances per unit time. The language recognition process is well known and will not be described.

  In step S29, the user terminal 20 performs laughter evaluation based on the voice of the person included in the recording data. The user side terminal 20 calculates the ratio T of the time during which the laughter is included in the recording time.

  In step S30, the user terminal 20 transmits the scoring value Q, the smile degree M, the number N of appearances, the rate T, the location information, and the restaurant name of the restaurant to the server 12, and then proceeds to step S31. move on. In step S31, the user terminal 20 waits for the end of transmission, ends the evaluation application, and returns to step S21.

<Processing of server 12>
In step S11 of FIG. 2, the server 12 transmits the designated restaurant information to the user terminal 20 and proceeds to step S12. In step S <b> 12, the server 12 determines whether there is data received from the user terminal 20. The server 12 makes an affirmative decision in step S12 and proceeds to step S13 when the data transmitted by the user terminal 20 in step S30 exists. If there is no data transmitted from the user terminal 20, the server 12 makes a negative determination in step S12 and returns to step S11.

In step S13, the server 12 receives the data from the user side terminal 20, that is, the scoring value Q, the smile degree M, the appearance number N, the ratio T, and the position information, and proceeds to step S14. In step S14, the server 12 calculates an evaluation score R (latest) by the following equation (1), and proceeds to step S15.
R (latest) = Q · k1 + M · k2 + N · k3 + T · k4 (1)
However, k1, k2, k3, and k4 are predetermined coefficients.

In step S15, the server 12 updates a database that stores evaluation information for each store. The server 12 updates the evaluation score R for the target store according to the following equation (2).
R (new) = (n × R (old) + R (latest)) / (n + 1) (2)
However, R (new) is the evaluation score (average value) after update, R (old) is the evaluation score (average value) before update, and R (latest) is the evaluation score calculated in step S14. . n is the number of samples used for calculating the average value.

  In step S15, when the server 12 updates the evaluation score R (new) for the target store, the process returns to step S11.

According to the embodiment described above, the following operational effects can be obtained.
(1) The restaurant information providing system 10 has a scoring process (S27) for scoring a dish based on a predetermined feature amount obtained from an image obtained by photographing a dish served at the restaurant, and a scene where a person eats the dish. A smile degree calculation process (S27) for calculating a smile degree M of a person's face based on an image obtained by photographing the food, scoring information (score value Q) of the dish, and evaluation score for the restaurant based on the smile degree information M The evaluation score calculation process (S14) for calculating R, the DB update process (S15) for storing the information indicating the restaurant, and the evaluation score R in association with each other, and the request received from the user-side terminal 20 The transmission process (S11) which transmits restaurant information to the user side terminal 20 is performed. Since the subjectivity of the person who eats food is difficult to enter, objective evaluation information about the restaurant can be obtained.

(2) The restaurant information providing system 10 of the above (1) further includes an appearance number calculation process (S28) for calculating the number N of occurrences of a predetermined word based on recorded data in which a scene of a person eating food is recorded. The evaluation score calculation process (S14) calculates an evaluation score R for a restaurant based on the cooking scoring information (scoring value Q), smile degree information M, and word appearance number information N. . Since the subjectivity of the person who eats food is difficult to enter, objective evaluation information about the restaurant can be obtained. By including the appearance number information N of a predetermined word, more multifaceted evaluation information can be obtained.

(3) The restaurant information providing system 10 of (2) further executes a laughter appearance rate calculation process (S29) for calculating the appearance rate T of the laughter based on recorded data in which a scene of a person eating food is recorded. Then, the evaluation score calculation process (S14) is based on the scoring information (scoring value Q) of the dish, the smile degree information M, the word appearance number information N, and the appearance rate T of the laughter. An evaluation score is calculated. Since the subjectivity of the person who eats food is difficult to enter, objective evaluation information about the restaurant can be obtained. By including the laughter appearance rate T, more multifaceted evaluation information can be obtained.

(4) The restaurant information providing system 10 of (3) includes a scoring process (S27), a smile degree calculation process (S27), an appearance number calculation process (S28), and a laughter appearance ratio calculation process (S29). Is executed on the user side terminal 20 that eats the dishes, the evaluation point calculation process (S14) and the DB update process (S15) are executed on the server 12 side, and the user side terminal 20 further provides the scoring information of the dish A transmission process (S30) for transmitting (scoring value Q), smile degree information M, word appearance number information N, laughter appearance rate T, and information indicating a restaurant to the server 12 side is executed. Since the captured image and the recorded data are held in the user terminal 20 and are not included in the information transmitted from the user terminal 20 to the server 12, a system in consideration of privacy can be obtained.

(Modification 1)
In the above description, the server 12 calculates the evaluation score R (latest) using the data from the user side terminal 20, that is, the scoring value Q, the smile degree M, the number of appearances N, and the ratio T. explained. Among these, the evaluation score R may be calculated by excluding the number N of occurrences of a predetermined word and the time ratio T of laughter during recording time. That is, the server 12 calculates an evaluation score R (latest) using the scoring value Q and the smile degree M.

(Modification 2)
Alternatively, the evaluation point R may be calculated by excluding either one of the number N of occurrences of a predetermined word and the time ratio T of the laughter during the recording time. That is, the server 12 calculates the evaluation score R (latest) using the scoring value Q, the smile degree M, and the time ratio T of the laughter during the recording time or the number N of occurrences of a predetermined word.

(Modification 3)
The screen shown in FIG. 5 that displays an evaluation score for a certain store may be further switchable to a screen that displays information indicating the scoring value Q calculated for each dish. The scoring value Q is objective information calculated from an image of the dish based on the color of the dish, the serving shape, the serving amount, and the degree of ingredient dispersion. By configuring the scoring value Q with objectivity so that it can be browsed, a user browsing this screen can be a clue to form an impression on the restaurant.

(Modification 4)
The program supply to the user terminal 14 may be performed by setting a storage medium 204 such as a CD-ROM storing the program in the user terminal 14 as illustrated in FIG. The user terminal 14 may be loaded by a method via the communication line 201. When passing through the communication line 201, the program is stored in the hard disk device 203 of the server 202 connected to the communication line 201. The program can be supplied as various forms of computer program products such as provision via the storage medium 204 or the communication line 201.

  On the other hand, the program may be supplied to the user-side terminal 20 such as a smartphone via a mobile phone line network (not shown) instead of the communication line 201, or the network 16 and the access point 18 as in FIG. It can also be supplied via.

  The above description is merely an example, and is not limited to the configuration of the above embodiment.

10 ... Restaurant information providing system 12 ... Server 14 ... PC
16 ... Network 18 ... Access point 20 ... User terminal

Claims (7)

A scoring process for scoring the dish based on a predetermined feature amount obtained from an image of the dish taken at the restaurant;
A smile degree calculation process for calculating a smile degree of the person's face based on an image of a scene where the person eats the dish;
An evaluation score calculation process for calculating an evaluation score for the restaurant based on the cooking scoring information and the smile degree information;
A storage process that associates and stores information indicating the restaurant and the evaluation point;
Upon request, transmission processing for transmitting the stored restaurant information to an external device;
The restaurant evaluation system characterized by performing. In the restaurant evaluation system according to claim 1,
Further performing an appearance number calculation process for calculating the number of appearances of a predetermined word based on recorded data in which the person eats the dish.
In the restaurant evaluation system, the evaluation score calculation processing calculates an evaluation score for the restaurant based on the scoring information of the dish, the smile degree information, and the appearance number information of the words. In the restaurant evaluation system according to claim 2,
Further executing a laughter appearance rate calculation process for calculating an appearance rate of laughter based on the recorded data in which the scene of the person eating the dish is recorded,
The evaluation score calculation process calculates an evaluation score for the restaurant based on the scoring information of the dish, the smile degree information, the appearance number information of the words, and the appearance ratio of the laughter. Store evaluation system. In the restaurant evaluation system according to claim 3,
The scoring process, the smile degree calculation process, the appearance number calculation process, and the laughter appearance ratio calculation process are executed at a terminal of the person who eats the dish,
The evaluation score calculation process and the storage process are executed on the server side,
The person-side terminal further transmits to the server side the cooking scoring information, the smile degree information, the word appearance number information, the laughter appearance rate, and information indicating the restaurant. A restaurant evaluation system characterized by executing a transmission process. A scoring process for scoring the dish based on a predetermined feature amount obtained from an image of the dish taken at the restaurant;
A smile degree calculation process for calculating a smile degree of the person's face based on an image of a scene where the person eats the dish;
An evaluation score calculation process for calculating an evaluation score for the restaurant based on the cooking scoring information and the smile degree information;
A storage process that associates and stores information indicating the restaurant and the evaluation point;
Upon request, transmission processing for transmitting the stored restaurant information to an external device;
A restaurant evaluation program characterized by causing a computer to execute. The scoring information of the dish calculated based on a predetermined feature amount obtained from an image obtained by photographing a dish served at a restaurant, and the image calculated based on an image of a scene where a person eats the dish An evaluation score calculation process for calculating an evaluation score for the restaurant based on smile information on the face of a person;
A storage process that associates and stores information indicating the restaurant and the evaluation point;
Upon request, transmission processing for transmitting the stored restaurant information to an external device;
A restaurant evaluation program characterized by causing a computer to execute. A scoring process for scoring the dish based on a predetermined feature amount obtained from an image of the dish taken at the restaurant;
A smile degree calculation process for calculating a smile degree of the person's face based on an image of a scene where the person eats the dish;
A transmission process for transmitting information indicating the restaurant, the scoring information of the dish, and the smile level information to an external device that calculates an evaluation score for the restaurant based on the scoring information of the dish and the smile level information; ,
A restaurant evaluation program characterized by causing a computer to execute.

Images