JP2017033401A - Customer information collection device, customer information collection system and customer information collection method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem in which information on customers not purchasing products and the like is not obtained, observation of sales clerks of the stores is low in reliability of information on the non-purchasing customer, interest or needs of the customer cannot be correctly obtained based on only behaviors of the customer obtained from cameras, and further, from the camera only installed in the stores or other input information, it cannot be checked how much the customer shows understanding with respect to products exhibited on shelves, and is willing to purchase on the basis of the information.SOLUTION: On a product shelf in a store selling the product, information about a product from devices outputting video images or sounds adjacent to the product is provided to customers, and a sensor captures reaction indicated by customers with respect to the information, and thereby deeper data is obtained that is owned by the customer with respect to the product. The data is collected at a plurality of stores, and thereby, a broad-range product strategy such as its product life, a next product planning, a sales strategy and the like can be obtained.SELECTED DRAWING: Figure 1

Description

  The present invention provides purchases made for customer attributes (gender, age group, etc.) and merchandise provided by the customer in the store shelf passage of a store that provides merchandise or services (hereinafter referred to as merchandise) to the customer.・ Customer information such as non-purchase decisions, customer judgment reasons and concerns at that time are estimated from customer behavior information obtained from cameras, microphones and other input devices connected to the customer information collection device, and as necessary Customer information collection device, customer information to collect customer behavior information from multiple stores, estimate customer's interest in the product etc. and purchase decision, and use it for product strategy, sales strategy etc. of the product etc. The present invention relates to a collection system and a customer information collection method.

  The reason why customers decide whether to purchase or not purchase products, etc., in the planning of products, etc., from the planning of products, etc. And even if the product is not purchased, the customer information about the product, etc. of the customer that the customer has expressed such as what features and specifications of the product, etc., is for the business that manufactures and sells the product etc. This is very important information. This is because such customer information allows businesses that develop products etc. to know the trends in the market and formulate more efficient sales strategies for the products that are currently being sold, etc. This information is indispensable in order to improve the brand of the business owner who sells the product, and is very important information.

  Conventionally, in order to obtain such customer information, it has been usual to enclose a questionnaire with products and ask the customer for an answer.

  In this method of obtaining customer information by questionnaire, customer information possessed by the purchased customer can be obtained, but it is difficult to know the customer information such as the reason why the customer who did not purchase did not purchase. there were.

  In addition, since the customer needs extra time to answer the questionnaire, the rate of obtaining answers from the customer is reduced, and even if an answer is obtained, the customer can see the true feelings in the questionnaire. There was a possibility of not answering, and it could not be reliable customer information.

  In addition, in order to know why a customer who did not purchase does not purchase, the store clerk observes the behavior of the customer's store and estimates why the customer does not purchase the product. However, this estimate depends on the individuality of the store clerk and could not be reliable customer judgment interest information. In addition, in order to increase the amount of information, it was necessary to mobilize a large number of people, and there was a problem that it was expensive.

  In recent years, in order to satisfy these demands, we used computers and various input devices to obtain the attributes of customers who visited the store, to obtain customer behavior patterns, and to analyze more detailed behaviors of customers. Some attempts have been made to efficiently obtain customer behavior data in stores such as focusing on the degree of attention of products and the like.

  The first attempt is a method of automatically obtaining customer information of a product by installing a camera at a POS register where purchase data can be directly obtained, obtaining attributes of the purchased customer (Patent Document 1).

  For example, according to Patent Literature 1, a POS register that can acquire information on the sale of a product and a customer's purchase at the time of product purchase are photographed with a camera, thereby converting the customer who purchased the product into data. To do. At this time, in order to determine the attributes of the customer, various processes that do not infringe on the privacy of the customer are added to the captured video. This system has made great progress in the data conversion of customer lists, such as what customers have purchased what products, which has been done by conventional people.

  However, in this system, data consisting of attributes of purchased customers can be obtained, but data relating to customers who did not purchase cannot be obtained. For example, it is not possible to know how many customers did not purchase and why.

  In addition, there is a problem that data regarding more detailed customer information such as how much the purchased customer is confused about the purchase decision and what kind of specification is focused on and decides to purchase cannot be obtained.

  The next attempt was to capture the customer's tracking data from this video information by taking a picture of the customer's behavior in the aisle in the store where the product is sold or in front of the product. It is intended to be used for sales promotion in other stores. (Patent Document 2)

  For example, according to Patent Document 2, a camera for photographing a customer's behavior is installed in a passage in front of a product shelf, an IC tag is attached to the product, and an IC tag reader installed in a store is installed. With these devices, it was possible to collect data related to customer behavior in stores, behavior in merchandise shelves, and customer movement with products. In addition, sales can be promoted by running advertisements of products from customer information collection installed on product shelves.

  This system makes it possible to grasp customers who have not purchased a product, and more detailed judgment information about the product of the customer can be obtained than before.

  However, the quality information, why the customer made a purchase decision for the product, or the non-purchase decision, and what specifications and features of the product the customer was interested in There was a problem that data on higher-quality customer information such as whether they had it, what specifications and features they did not like, etc. could not be obtained.

Japanese Patent No. 4230049 JP 2014-56356 A

  The problem to be solved is that the information of customers who did not purchase products cannot be obtained by putting a questionnaire into the products, etc., the information of customers who did not purchase by observation of store clerk is low in reliability, camera It is said that the customer's interests and demands cannot be known more accurately from the mere behavior of the customer obtained from.

  Also, even if you can grasp the customer's passing behavior from the camera and other input information installed at the store, you can understand how much the products on display are understood, and you want to purchase based on that information It is a point that cannot be confirmed whether it is thinking. Without these pieces of information, it was impossible to obtain information that the producers really wanted to know when planning a product, such as the functions, specifications, and prices required by customers.

  The present invention has been made in order to solve such a problem, and its purpose is to grasp in detail the behavior of the customer displayed at the store and how the customer thinks about the behavior from this behavior. It is an object of the present invention to provide an apparatus and method that can obtain more detailed customer information such as whether or not a purchase or non-purchase has been determined.

  In order to solve the above-described problems, a customer information collecting apparatus, a customer information collecting system and a customer information collecting method using the same according to the present invention provide the following.

  (1) In a customer information collection device installed adjacent to a product on a product shelf installed in a store, information on the product to be provided to the customer is created on the PC portion that is a part of the customer information collection device. Product information providing unit, a passing customer number counting unit for counting the number of customers passing through the passage in front of the product shelf, and a video display of the customer information collecting device by the customer passing through the passage in front of the product shelf A customer visual recognition determination unit that determines that the screen of the part has been visually recognized, a customer attribute estimation unit that estimates an attribute of the customer viewed in the previous period, and the customer visually recognized in the previous period are adjacent to the customer information collection device or the customer information collection device A customer approach determining unit that determines that the product is close to the installed product, a product contact determining unit that determines whether the approaching customer has picked up the installed product, and the product for settlement place It includes software consisting of a product purchase determination unit that determines whether it has been carried, and includes a video display unit that displays information provided by the product information providing unit, a camera that captures video on the PC portion, and a sensor that recognizes the customer's hand Customer information collection device included as an element.

  According to the present invention, the number of customers passing through the passage before the product display, whether the passing customer is interested in the product displayed beside the passage, and the interested customer Whether this customer wants a detailed description of the item, whether the customer actually picked up the item, actually checked the item, and whether it was carried from the item shelf to purchase the item, And you can know the gender and approximate age that are the attributes of this customer.

  (2) The product information providing unit corresponds to at least one of the result of the customer visual recognition determination unit, the result of the customer attribute estimation unit, the result of the customer approach determination unit, and the result of the product contact determination unit. And the customer information collection device characterized by changing the contents to provide interactively.

  According to the present invention, it is possible to interactively change the information provided from the customer information collection according to the customer's interests and attributes, instead of providing uniform information to the customer. You can collect information that interests you.

  (3) A customer visual recognition determination unit that determines whether a customer visually recognizes a screen of a video display unit that displays the information provided by the product information providing unit is a feature point of a customer's face from the video information captured by the camera A customer information collection device comprising: a feature point extraction unit that extracts a customer face, and a customer face confrontation determination unit that determines whether the customer is facing the product from the movement of the feature point.

  According to the present invention, whether or not a customer who is passing through a passage before displaying a product is interested in the product displayed beside the passage is determined by a computer process from a customer image captured by a camera. Because it is judged from the movement, the data is highly reliable, and important customer information such as whether the customer who did not purchase was not interested at all or whether it was interested but did not reach the purchase Can be obtained.

  (4) It includes a customer attribute estimation unit for estimating the sex and age group of a customer from the extracted facial feature points of the customer visually recognized by the customer visual recognition determination unit and the outline shape of the customer's face. Customer information collection device.

  According to the present invention, the attributes of the customers who are interested in the product among the customers who are passing through the aisle before the product display are judged from the feature points, the contour shape, etc. by computer processing from the image of the customer photographed by the camera. Therefore, the data is highly reliable, and detailed classification such as a customer who has made a purchase decision and a customer who has not made a purchase can be performed for each attribute.

  (5) The customer approach determination unit determines that the customer has approached when the contour shape of the customer captured from the video information captured by the camera exceeds a certain value from the initial shape. Customer information collection device.

  According to the present invention, whether or not a customer who is passing through a passage before displaying a product is more interested in the product displayed beside the passage depends on the degree of access from the size of the customer's image captured by the camera. As a result, the data is highly reliable, and it is possible to obtain important customer information indicating how much of the customers viewed in the passage approached the product.

  (6) The customer information collection device includes a Doppler sensor in a peripheral portion of the video display unit, and the customer approach determination unit determines that the approach has occurred because the Doppler amount detected by the Doppler sensor exceeds a certain value. A customer information collecting device characterized by:

  According to the present invention, whether or not a customer who is passing through a passage before displaying a product is more interested in the product displayed beside the passage is determined by the Doppler sensor in the Doppler wave irradiation area. ) Is detected and it is determined whether or not the customer has approached the product, so the data is highly reliable and what percentage of the customers viewed in the aisle You can get important customer information that you are approaching.

  (7) The product contact determination unit corresponds to the customer's hand when the amount of infrared detected by the infrared sensor exceeds a certain value by the infrared sensor attached to the periphery of the video display unit. A customer information collecting apparatus characterized by determining that a product has come into contact.

  According to the present invention, whether an approaching customer has picked up the corresponding installed product is determined by the infrared sensor attached to the peripheral part of the screen of the video display unit. When the amount of infrared rays from the generated object exceeds a certain value, it is judged that the customer's hand and the corresponding product are in contact, so the data is highly reliable and the data of the customer approaching the product It is possible to obtain important customer information such as how many customers have picked up the product.

  (8) The product contact determination unit extracts a feature point of the customer's hand captured from the video information captured by the camera, and determines that the customer's hand and the corresponding product are in contact with each other. To collect customer information.

  According to the present invention, whether a customer approaching a product installed in the vicinity of the product information providing unit has picked up the corresponding product installed is determined by photographing the hand detected as the product with a camera. Because the data is judged from the recorded video information, the data is highly reliable, and important customer information on how many of the customers who approached the product have picked up the product is obtained. Can do.

  (9) The customer information collection device has a microphone in the periphery of the video display unit, and the product contact determination unit, when the sound when the customer contacts the product with the microphone exceeds a certain value, A customer information collecting apparatus, characterized in that it is determined that the customer's hand contacts the corresponding product.

  According to the present invention, whether or not the approaching customer has picked up the corresponding product is determined by the microphone attached to the periphery of the screen of the video display unit when the customer picks up the product. When the sound is collected and the volume exceeds a certain value, it is determined that the customer's hand is in contact with the product, so the data is highly reliable and the customer is closer to the product. Among them, it is possible to obtain important customer information such as how many customers have picked up the product.

  (10) The customer information collection device is connected to a pressure sheet that senses a pressure installed under a product placed on a product shelf, and the product contact determination unit has a constant pressure amount felt by the pressure sheet. The customer information collecting device characterized by determining that the customer's hand is in contact with the corresponding product when the value falls below

  According to the present invention, whether or not the approaching customer has picked up the corresponding installed product is determined by installing a pressure sheet for sensing pressure under the product, and a pressure amount sensed by the pressure sensor is constant. When the value falls below this value, it is determined that the customer's hand has come into contact with the product in question, so the data is highly reliable, and what percentage of customers who are close to the product It is possible to obtain important customer information indicating whether the product is picked up.

  (11) When the value of the infrared sensor determined that the product is in contact with the customer's hand is not increased again, the product purchase determination unit carries the product to the cash register for purchase procedure. A customer information collecting device characterized by judging.

  According to the present invention, when the value of the infrared sensor determined that the customer's hand and the product are in contact with each other is not increased again by the customer who picked up the product, the customer's hand holding the product is It is determined that the product has not been approached, that is, the product has not been returned to the shelf and has been carried to the cash register for purchase procedures. For this reason, the data is highly reliable, and it is possible to obtain important customer information indicating how many of the customers who have picked up the product have taken the product to the cash register for the purchase procedure.

  (12) The product purchase determination unit takes the product picked up by the customer with the camera, and the product is moved to the cash register for the purchase procedure when the product is moved out of the screen. A customer information collecting device characterized in that

  According to the present invention, a customer who picked up a product takes a picture of the product with the camera, and the product is moved to the outside of the screen. Therefore, the data is highly reliable and can provide important customer information about how many of the customers who picked up the product have taken the product to the checkout for purchase. .

  (13) When the product purchase determination unit detects that the amount of pressure sensed by the pressure sensor in the pressure sheet placed under the product is below a certain value and does not return within a certain time, the customer A customer information collecting device that judges that the product has been carried to a cash register for purchase procedures.

  According to the present invention, whether the customer who picked up the product has carried the product to the cash register for the purchase procedure is returned to the pressure sensor product of the pressure sheet installed under the product. If there is no item, it is determined that the customer took the item from the shelf and brought it to the cash register. For this reason, the data is highly reliable, and it is possible to obtain important customer information indicating how many customers who have purchased the product have purchased the product.

  (14) The customer information collection device according to any one of (1) to (13) is installed in a plurality of stores and is installed in a plurality of stores, each connected via a network, and information on all stores Customer information collection system that collects and analyzes data.

  According to the present invention, customer information collection devices are installed in a plurality of stores, and each is connected via a network. From each customer information collection device, the name of the installed distribution store, the location in the store, the displayed product in the adjacent zone, the shelf structure, the location of the shelf on which the product is placed, whether the campaign has been implemented, customer information Together with data such as the screen size of collection, presence / absence of salesperson, presence / absence of mannequin, data such as date / time of collecting customer information, day of the week, weather, etc. are also collected. Since these data are collected and analyzed, it is possible to obtain important customer information related to the product.

  (15) A step of showing information related to a product to a customer who is passing through a passage before the product display, a step of counting the number of customers who are passing, and a screen or proximity of a video display unit attached to the customer information collecting device A step of judging that the corresponding product that has been installed has been visually recognized, a step of estimating the attribute of the visually recognized customer, and a corresponding product in which the visually confirmed customer is installed in proximity to the product information collection device Determining whether the customer approaching the product has picked up the product, and determining whether the product has been taken to a place for checkout. Characteristic customer information collection method.

  According to the present invention, by the customer information collection device, the number of customers who are passing through the passage before the product display, the number of customers who viewed the screen of the product information providing unit, Number of people approaching the corresponding product installed in the proximity of the product information provider, and the number of customers approaching the product installed in proximity to the product information provider picking up the corresponding product installed , The number of buyers who brought this product to the checkout location, the customer's residence time before the purchase, or the customer's product before the purchase Important customer information such as residence time can be obtained.

  (16) A method for collecting customer information, comprising: displaying the content of the screen of the video display unit to the visually recognized customer by changing the screen to a screen having a content suitable for the estimated attribute.

  According to the present invention, the customer information collection device displays the content of the screen of the video display unit to the customer whose visual recognition is determined, by changing the content of the screen to a screen suitable for the estimated attribute. More detailed customer information such as judgment criteria can be obtained.

  (17) For a customer approaching a product installed close to the product information providing unit, the content of the screen of the video display unit is changed to a screen having a content suitable for the estimated attribute and displayed. A method for collecting customer information.

  According to the present invention, the customer information collection device adapts the content of the screen of the video display unit to the estimated attribute for the customer who has approached the product installed close to the product information providing unit. By displaying the content on the screen, it is possible to obtain more detailed customer information such as customer interests and judgment criteria.

  (18) For a customer approaching a product installed close to the product information providing unit, the screen is changed to a screen of content selected by the customer using a touch panel installed on the surface of the screen of the video display unit. A customer information collecting method comprising steps.

  According to the present invention, the customer information collecting device allows the customer who has approached the product installed close to the product information providing unit to the customer by the touch panel installed on the surface of the screen of the video display unit. By displaying the selected content instead of the screen, it is possible to obtain more detailed customer information such as customer interests, judgment criteria, and the like.

  (19) The method includes a step of changing the screen content of the video display unit to a screen with a different content for a customer who has been judged to have picked up the corresponding product by the customer information collection device. Customer information collection method.

  According to the present invention, the customer information collection device displays the content of the screen of the video display unit changed to a screen that matches the estimated attribute for the customer who is determined to have picked up the corresponding product. This makes it possible to obtain more detailed customer information such as customer interests, judgment criteria, and the like.

  The customer information collection apparatus, customer information collection system, and customer information collection method of the present invention include not only customers who have purchased the corresponding product among the customers in the store, but also those customers who have not been purchased. Interested in such product information, it is possible to obtain information that is important in selling such products, such as what kind of information has been decided to purchase, with high reliability.

  The effect of the present invention will be described more specifically. The customer information collection device has a video display unit and a speaker, and information related to products and the like for explaining to the customer is stored in advance in a product information providing unit inside the PC portion. When the customer passes through the passage, the information is provided to the customer via the video display unit and the speaker. When the customer passing through the passage is interested in information on these products, the customer looks back at the product or the video display unit that provides the information. This turning action is recognized by taking a picture of the customer's face. Furthermore, a customer who is interested in this product approaches this product and the video display unit. This approach includes a method of judging from the image of the camera and a method using a Doppler sensor. More interested customers take a look at the product. This customer movement includes a method of judging from a camera image, a method using an infrared sensor, a method using a microphone, and a method using a pressure sensor. Here, the customer who has decided to purchase the product operates to carry the product to the cash register without returning it to the shelf. This movement includes a method of judging from the image of the camera and a method using an infrared sensor. In addition, when the customer is simply passing, when the customer turns to the product or the information about the product provided by the video display unit and the speaker, when the customer approaches the product, the customer is in the video display unit. When the input is made from the pasted touch panel, the contents to be provided are changed by the product information providing unit. Based on these series of exchanges and the customer's residence time before the corresponding product, the customer who purchased the product was interested in what kind of information and decided to purchase, and conversely, what the customer did not purchase. It is possible to collect customer information in detail as to whether or not to decide not to purchase because of dissatisfaction with such information.

  Also, customer attributes such as customer gender and approximate age are estimated from feature points and face contours of the customer's face taken by the camera.

  Customer information collection device installed on store shelves obtains customer information data and attribute data indicated by customers in front of these products, etc., and this customer information collection device is connected to multiple stores via the network. A customer information system is created that connects all the information to the server.

  When collecting customer information on the server, in addition to the above customer information data and attribute data, add external factor data such as weather, day of the week, etc. Data such as the location of the product, the product displayed in the adjacent zone, the structure of the shelf, the location of the shelf where the product is placed, whether or not the campaign is implemented, the screen size of the video display, the presence or absence of a salesperson, the presence or absence of a mannequin To be collected.

  Based on these data, product planning, branding, targeting, package concept, pricing, product strategy such as product revision and abolition, optimal placement of inventory, promotion planning, optimization of sales promotion expenses, sales floor planning, store / store zone evaluation A customer information collection device, a customer information collection system, and a customer information collection method that can plan a sales strategy such as review of the customer information are provided.

It is a figure explaining the situation where the customer information collection device which consists of this invention collects customer information from the customer who is passing the passage of the store, 11 is customer, 12 is customer information collection device, 13 is passage, 14 is applicable Product, 15 is another product, 16 is a product shelf, 17 is a camera, 18 is an infrared sensor, and 22 is an image display unit. 1 is a diagram showing a configuration of a hardware unit of a customer information collecting apparatus 12 according to the present invention, in which 21 is a PC unit, 22 is a video display unit, 27 is a speaker, 17 is a camera, 18 is an infrared sensor, 26 is a touch screen, 28 Indicates a microphone, respectively. FIG. 2 is a diagram illustrating a configuration of a software unit of a customer information collecting apparatus 12 according to the present invention, and these software units are installed in a PC unit 21. These software units include 31 a product information providing unit, 32 a passing customer number counting unit, 33 a customer visual recognition determination unit, 34 a customer attribute estimation unit, 35 a customer approach determination unit, 36 a product contact determination unit, 37 Has a product purchase decision section. It is a figure explaining the part which the customer information collection apparatus 12 which consists of this invention counts the number of the customers who pass a store passage. Reference numeral 11 denotes a customer, and 41 denotes a video screen captured by the camera of the customer information collecting apparatus. It is a figure explaining the part which the customer information collection apparatus 12 which consists of this invention recognizes the customer who turns around the image display part 22 of the applicable goods 14 or a customer information collection apparatus among the customers who pass an in-store passage. Reference numeral 51 denotes a customer eye feature point, 52 denotes a customer nose feature point, 53 denotes a customer mouth feature point, and 54 denotes a customer face contour feature point. It is a figure explaining the part which the customer information collection apparatus 12 which consists of this invention recognizes the customer who approaches the customer information collection apparatus 12 or the applicable goods 14 among the customers who look around the video display part 22 of the customer information collection apparatus 12. FIG. 61 is a feature point of the approaching customer's eye, 62 is a feature point of the approaching customer's nose, 63 is a feature point of the approaching customer's mouth, and 64 is a feature point of the approaching customer's face. The customer information collecting device 12 according to the present invention is a video screen captured by a camera when a customer approaching the customer information collecting device 12 or the corresponding product 14 tries to pick up the corresponding product 14. 71 is the customer's hand extended to the corresponding product 14, 11 is the customer, and 14 is the corresponding product. It is a figure explaining the part which the customer information collection apparatus which consists of this invention recognizes the customer who decided to purchase applicable goods among the customers who look at applicable goods. 11 is a customer and 14 is a corresponding product. It is a block diagram which shows the customer information collection system which consists of this invention. 91 is a network, 92 is a customer information collection device of each store, and 93 is a server. It is a flowchart explaining the customer information collection method which consists of this invention. It is a flowchart of the passing customer number counting part 32 which consists of this invention. It is a flowchart explaining the customer visual recognition judgment part 33, the customer attribute estimation part 34, and the customer approach judgment part 35 which consist of this invention. It is a flowchart explaining the goods contact judgment part 36 and the goods purchase judgment part 37 which consist of this invention. It is a flowchart explaining the goods purchase judgment part 37 which consists of this invention. It is a flowchart of the customer's feature point extraction and utilization part which consists of this invention.

  FIG. 1 is a schematic view showing a scene in which a customer information collecting apparatus 12 according to the present embodiment collects customer information for a customer 11 in a store. The customer 11 is walking through the store aisle 13. The customer 11 passes in front of the product shelf 16 on which the corresponding product 14 and other products 15 are displayed. Next to the corresponding product 14, a customer information collecting device 12 according to the present invention is installed. This device customer information collecting device 12 collects information about the corresponding product 14 of the customer 11 who passes.

  The customer information collection device 12 includes a hardware part and a software part, and the software part exists in a storage device inside the PC part 21. FIG. 2 is a diagram illustrating a configuration of a hardware unit of the customer information collecting apparatus 12 according to the present embodiment. The main components include a PC unit 21 having a processing device and a recording device, a video display unit 22, a speaker 27, a camera 17, an infrared sensor 18, a touch screen 26, and a microphone 28.

  FIG. 3 is a schematic diagram showing a software part built in the PC unit 21 of the customer information collecting apparatus. The software includes a product information providing unit 31, a passing customer number counting unit 32, a customer visibility determining unit 33, a customer attribute estimating unit 34, a customer approach determining unit 35, a product contact determining unit 36, and a product purchase determining unit 37. Has a part.

  Hereinafter, a procedure for collecting information on the corresponding product 14 of the customer 11 from the customer 11 walking in the store passage by the customer information collecting device 12 according to the present embodiment will be described.

  As shown in FIG. 1, when the customer 11 passes through the store passage 13, the product information of the corresponding product 14 is passed through the video display unit 22 and the speaker 27 of the customer information collection device 12 in accordance with the software of the product information providing unit 31. 13 for customers 11 passing through. In a state where the customer is walking along the passage, information for appealing that the corresponding product 14 exists in the product shelf 16 is sent. This information includes information that indicates the characteristics of this product, circulates price information, comparison information with other companies' products, and is likely to be of interest to customers.

  In this embodiment, the product information of the corresponding product 14 is provided to the customer 11 passing through the passage 13 through the video display unit 22 and the speaker 27 of the customer information collection device 12. It is also possible to provide only one of the audio information.

  In this example, as information for appealing that the corresponding product exists on the product shelf, the characteristics of this product are indicated, price information, comparison information with other companies' products, and the customer is interested. Although such information has been distributed, the contents of this information can be changed according to the configuration of the product shelf and the product sales strategy, and the content is not particularly limited.

  In the present embodiment, when the customer 11 passes through the store passage 13, the product information providing unit 31 starts providing information on the product 14, but this timing is not limited to this.

  Next, the customer information collection device 12 according to the present embodiment counts the number of customers 11 that have passed through the passage 13. The traffic customer number counting part will be described. FIG. 4 shows that the customer 11 who has passed through the passage 13 passes in front of the product shelf 16 on which the corresponding product 14 is displayed. FIG. 11 is a flowchart of the number-of-passengers counting unit 32 that is software that defines the operation of the customer information collection device 12 in this scene.

  The operation of the passing customer number counting unit 32 will be described with reference to FIG. The camera 17 of the customer information collection device 12 captures a moving image toward the passage. Captured frame images are taken and difference detection between frames is performed in time series. If there is a moving object in the frame image, a difference is generated, and the contour of the object in which the difference has moved is formed. In this embodiment, since there is usually no moving object other than the customer 11, the customer 11 is set as the target 1 in the video captured by the camera 17 when this contour is detected. When the target 1 is set, time measurement is started. Then, it is determined whether or not the object A is facing the camera. The facing determination is performed according to the flowchart described in FIG. If it is determined that the person is not facing in the face-to-face determination, and it is determined that the object A does not stay in the frame but has gone out of the frame, it is determined that the object has passed, the counter is activated, and the number of persons passing is accumulated. . At this time, in this embodiment, the passage time is also recorded. On the other hand, the number of customers and the time of customers who are determined to be facing in the facing determination and the customers who are not facing but stay in the frame are also recorded.

  In the above method, the customer who has not passed the face and has passed is estimated to be a customer who is not interested in the product 14 at all. And the number of customers belonging to these groups and the residence time can be obtained. On the other hand, it is estimated that the customer who remains in the frame of the camera has some interest in the product information provided from the corresponding product 14 or the customer information collection device. Then, the number of customers belonging to this group and the time staying in front of the corresponding product are recorded.

  Next, the customer visual recognition determination unit 33 will be described. In FIG. 5, the customer 11 passing through the passage 13 passes in front of the product shelf 16 on which the corresponding product 14 is displayed, and is provided through the video display unit 22 and the speaker 27 of the corresponding product 14 or the customer information collecting device 12. It is a figure explaining the scene which showed interest in merchandise information and the customer 11 turned to the applicable merchandise 14 or the customer information collection apparatus 12. FIG. FIG. 12 is a flowchart of the customer visual recognition determination unit that is software that defines the operation of the customer collection device 12 in this scene.

  The operation of the customer visual recognition determination unit 33 will be described with reference to FIG. To determine whether or not the customer is interested in the corresponding product, the customer is photographed by the camera 17 and the captured frame image is captured again. The feature points of the customer's face are extracted from this frame image. More specifically, the fact that the customer 11 turned around with interest in the information provided from the product information providing unit 31 displayed on the corresponding product 14 or the video display unit 22 is that the customer's face photographed by the camera 17 is reflected. Judged from the frame image. First, eyes, nose, and mouth, which are facial features, are detected from the recaptured frame image. Here, if it cannot be detected, it is determined that the person has not faced, that is, has no interest.

  Using FIG. 15, the feature points of the customer are extracted and the use of the data will be described. When eyes, nose, and mouth are detected, face vector data human feature extraction is performed from these eye, nose, and mouth shape data. The feature-extracted data is registered as face vector data in the database as person 1. Thereafter, the face vector data characterizing the person 1 is recorded together with the subsequent action data. The face vector data is also used for determination of gender and age.

  Specifically, the face vector data human feature extraction detects the contour of the eye as the feature point 51 of the eye, the contour of the nose as the feature point 52 of the nose, and the end of the mouth as the feature point 53 of the mouth. From these extracted feature points, both eyes are recognized, the position of the nose is located in the center of the face, the entire mouth is captured, and whether or not these feature points are in the center of the face contour, the customer 11 It is determined whether or not the face of the person has faced up. For the customer who is considered to have faced, a face-to-face state flag is set, and the count-up of the time to face is started.

  When the customer information collecting apparatus 12 recognizes that the customer 11 is directly facing, that is, interested in the corresponding product 14, the product information providing unit 31 switches the information to be provided to providing more detailed information on the corresponding product 14. It is also possible to calculate the visibility rate of all the customers who have passed so far, and switch to providing more detailed information on the appropriate product 14 according to the visibility rate. Moreover, it can also switch to provision of the more detailed information of the appropriate applicable goods 14 with the time which the customer is visually recognizing.

  When the feature points of the face of the customer turned around are extracted, the customer attribute estimation unit 34 estimates the customer attribute. The distinction between men and women is estimated according to the database from the hairstyle, facial feature points, clothes, and the like. The age is estimated according to the database from facial feature points, facial skin wrinkles, posture, and the like.

  When the customer information collection device 12 estimates the attribute of the customer 11, the product information providing unit 31 switches the information to be provided to providing more detailed information on the corresponding product 14 suitable for the customer's attribute.

  Next, the customer approach determination unit will be described. FIG. 6 shows a camera in which the customer 11 who turns with interest in the product information provided from the product information provider 31 of the product 14 or the customer information collection device 12 approaches the product or the customer information collection device 12. 17 is a video imaged by 17. The feature point 64 of the approached customer's face contour, the feature point 61 of the approaching customer's eye, the feature point 62 of the approaching customer's nose, and the feature point 63 of the approaching customer's mouth are compared in time series. The increase rate of these feature points is required. When the increase rate exceeds a certain value, the customer approach determination unit 35 determines that the product approaching the product information providing unit is approaching.

  FIG. 12 is a flowchart of the customer approach determination unit 35 which is software that defines the operation of the customer information collection device 12 in this scene. For the customer 11 in which the facing state flag is set, the frame video is captured again. It is determined whether or not the eyes, nose, and mouth are at the center of the outline of the customer's face in the captured image. If there is, it is determined that the customer 11 continues to face. If it is not at the center, it is determined that the confrontation has ended. Next, it is determined whether or not the eyes, nose, mouth, and face outline at the time of first facing are enlarged at the same ratio. This determination is made based on whether the enlargement ratio is increased or exceeds a certain value. When the enlargement is determined, it is determined that the customer 11 is interested in the product 14 and has approached.

  In the embodiment described above, the customer approach determination is performed using the video image of the camera according to claim 5, but in the invention of claim 6, the customer approach is determined using the Doppler sensor. Whether a customer traveling in the aisle before the product display is more interested in the products displayed next to the aisle, an object (hand, arm) has entered the Doppler wave irradiation area by the Doppler sensor. Is detected, and it is determined whether or not the customer has approached the product. Therefore, the data is highly reliable, and it is important to determine how much of the customers viewed in the aisle approached the product. Information can be obtained.

  Further, in this embodiment, the infrared sensor 18 installed in the information collecting device 12 measures the amount of infrared rays emitted by the perceived customer and determines the approach of the customer. The approach of the customer is also determined by combining the data of the customer contour increase rate by the camera and the data of the amount of infrared rays.

  When the customer approach determining unit 35 of the customer information collecting device 12 determines that the customer 11 has approached the corresponding product or the customer information collecting device 12, the product information providing unit 31 provides more detailed information of the corresponding product 14 to the information to be provided. Can be switched to interactive. Moreover, the sound volume emitted from the speaker 27 can be changed according to the approach of the customer.

  As shown in FIG. 7, there is an action of picking up the corresponding product 14 as the next action of the customer 11 who has approached the product installed close to the product information providing unit. The determination of this behavior is performed according to the product contact determination unit. This determination result is data indicating an important action as the customer 11 has a strong interest that leads to purchase. Specifically, it is recognized using data of both or one of the camera 17 and the infrared sensor 18 attached to the customer information collection device 12.

  In the present embodiment, the infrared sensor 18 captures infrared rays emitted from the customer's hand. When the amount of infrared rays exceeds a certain value, it is determined that the customer's hand has approached the position for picking up the product. FIG. 13 is a flowchart of the merchandise contact determination unit 36 which is software that defines the operation of the customer information collection device 12 in this scene. A frame image is captured again for the person 1 whose approach has been confirmed. It is confirmed whether or not the person 1 is detected in the captured image, and if it is detected, it is checked whether or not the infrared sensor senses infrared rays emitted from the hand of the person 1. If it is detected, it is determined that the customer 11 as the person 1 has picked up the corresponding product.

  In another embodiment, the feature of the product is input to the customer information device in advance, and it is determined that the customer has picked up the product by reflecting the product in the video information of the customer photographed by the camera 17. In FIG. 8, the corresponding product 14 is captured in the hands of the customer 11 in the video screen 41 captured by the camera 17.

In another embodiment, the amount of infrared rays emitted from the customer's hand is measured by the infrared sensor 18 and the product is reflected in the customer's video information captured by the camera. , Determine that the customer has picked up.

  In another embodiment, a pressure sheet having a pressure sensor is laid under the product in the product shelf. The pressure sensor changes its electrical characteristics when a certain weight or more is placed on the sheet. When a customer approaching a product installed adjacent to the customer information collection device picks up the product, the pressure sensor senses that the weight has decreased, and the product contact determination unit 36 with this reaction, Assume that the customer has picked up the product.

  The product information provided from the product information providing unit 31 of the customer information collecting device 12 is matched with the customer's attributes and the customer's interest according to the timing when the customer 11 approaches the product or picks up the product. Change content interactively. Information that the customer wants to know can be selected by the touch screen 26 attached to the surface of the video display unit 22. In addition, it is possible to learn the behavior of the customer so far and change the product information provided according to the result interactively.

  As shown in FIG. 3, the customer information collection device 12 determines the purchase of the product by the customer according to the product purchase determination unit 37. When a customer purchases a product that the customer has picked up, the customer places the product in a shopping basket or cart, or picks it up and carries it to a cash register. The value of the infrared rays emitted from the customer measuring the infrared sensor increases when the product is picked up, and when the hand holding the product moves away from the infrared sensor, the amount of infrared rays decreases, and the amount of infrared rays does not increase. However, the product purchase determination unit 37 determines that the customer 11 has taken to the cash register for purchase without returning to the product shelf, and purchase is determined.

  The lower part of FIG. 13 is a flowchart of the product purchase determination unit 37, which is software that defines the operation of the customer information collection device 12 in this scene. A frame image is captured again for the person 1 whose contact with the corresponding product 14 is confirmed. The person 1 is not detected in this frame image. It is determined that the person 1 takes away the corresponding product 14 in his / her hand, that is, carries the corresponding product 14 to the cash register for purchase procedure and purchases it.

  FIG. 14 is a flowchart of the first half of the product purchase determination unit 37, which is software that defines the operation of the customer information collection device 12 in the next scene. When the infrared sensor detects infrared rays again, it is estimated that the person 1 has returned the corresponding product 14 to the original product shelf, and the person 1 is determined not to purchase the corresponding product 14. Further, when it is captured that the hand of the person 1 has again extended to the product shelf in the video taken by the camera instead of the infrared sensor, it is determined that the person 1 has not purchased the product 14. On the other hand, if the infrared sensor does not detect infrared rays again, and the eyes, nose, and mouth that are the features of the face of the person 1 are not detected, the person 1 does not return the corresponding product 14 to the product shelf. In this case, it is determined to be purchased.

  In another embodiment, the product picked up by the customer is photographed with the camera 17, and the product is moved to the outside of the screen, so that the product 14 is carried to the cash register for purchase procedure. The purchase determination unit 37 makes the determination.

  In another embodiment, the purchase of the product by the customer is determined by the customer information collection device according to the product purchase determination unit 37 using a pressure sheet placed under the product 14. When a customer purchases a product that is picked up, the customer places the product in a shopping basket or cart, or picks it up and carries it to a cash register. When the amount of pressure felt by the pressure sensor on the pressure sheet placed under the product 14 is below a certain value and this value does not return within a certain time, this customer is in charge of purchasing the product 14 The product purchase determination unit 37 determines that the item has been carried to the cash register.

  In the above embodiment, one camera is used to grasp the customer's behavior, but a plurality of cameras may be used. Further, the obtained video information can be three-dimensionally processed and used for customer behavior determination.

  In the above-described embodiment, the input unit touch screen 26 is used to select customer product information. However, the customer may perform selection input by voice input using the microphone 28.

  In the above embodiment, the camera 17, the microphone 28, the infrared sensor 18, the speaker 27, the video display unit 22 and the PC unit 21 are integrated to grasp the customer's behavior, but may be configured separately. .

  FIG. 9 is a diagram for explaining the overall configuration of an embodiment of the customer information survey system according to the present invention. The customer information collection device 92 of each store shown in FIG. 2 is connected to the server 93 through the network 91. The server 93 is connected to another customer information collecting device of the same store or a customer information collecting device 92 of another store, and can collect data of all installed customer information collecting devices.

  The customer information for the corresponding product for each different store data obtained in this way is divided into POS data, climate, month, date, and day of the week as necessary, and external factor data is added. Product planning, branding, targeting, package concept, pricing, product reform and abolition, optimal inventory placement, etc., and promotion planning, optimization of sales promotion expenses, sales floor planning, review of store / store zone evaluation, etc. It becomes possible to make a strategy.

  External factor data includes: distribution store name, sales force of the store, shelf size at the store, provided information, size of the information provision device screen, shelf position in the store, presence / absence of campaign, paper There are merchandising situations such as pop, presence / absence of salesperson, presence / absence of recommended sales.

  Next, each step of the operation of the optimum embodiment of the customer information collecting method of the present invention will be described with reference to FIG.

  In the first step, based on the product information providing unit 31, product information is provided by a video display unit or a speaker of a customer information collecting device installed on a product shelf facing the passage. The description start of the corresponding product may be synchronized with the timing captured by the customer in the screen, and if the customer passes a certain number or more, the fixed description may be repeated.

At the top, the passage is photographed with a camera attached to the customer information collecting device. When a passerby passes through the aisle and passes in front of the customer information collection device, the customer enters the screen of the camera that is shooting and records video information. Passers who pass through the screen are counted from the time-series changes in this record. The number of passengers is output as data based on the number of passengers counting unit 32.

  In the third step, in response to the explanation of the corresponding product performed by the video display unit and the speaker, the customer visual judgment unit determines whether the customer who tried to pass through the passage turned around the video display unit or the corresponding product. Judgment by 33 is made. Whether or not the customer turned to the video display part or the product, whether the object captured by the camera stayed within the screen for a certain period of time was identified, and whether or not this face turned to the camera Judging. This process is performed by detecting the contours of the eyes, nose, mouth, and face from the supplemented object image, and determining whether the relative position corresponds to the front.

  The data of the customer who passes through the passage without being responded to the explanation of the corresponding product performed by the video display unit and the speaker is output here. In this step, it is determined which image on the video display unit the customer has responded to stay in the screen and faced, or which sound of the speaker has reacted to stay in the screen and faced. Further, in this way, the customer who stayed within the screen for a certain period of time or the customer's face turned to the camera is determined to be the customer who showed interest in this product, and this customer's reaction and customer Is collected on the server together with the contents of the product description that has shown interest.

  In the fourth step, when the customer attribute estimation unit 34 takes a picture of an enlarged customer approaching the corresponding product by the camera 17, the feature is extracted from the customer image, and sexes, children, adults And other attributes are determined. These determinations are made by comparison with an already stored database. Here, the database used for the judgment is a commercial database in which the characteristics of the Japanese as a whole are used as a database.

  The fifth step is performed by the customer approach determination unit 35. It is determined whether the customer identified as interested in the explanation in the third step further approaches the product or the terminal from the passage, and different contents are provided according to the approach of the customer.

  Whether or not the product or the terminal is approached from the passage is determined based on whether or not the contour image of the customer recognized that the customer's face is facing the camera or the product has been enlarged to a certain size. In addition, the infrared sensor 18 installed in the customer information collecting device 12 can measure and judge the amount of infrared rays emitted by the perceived customer. The approach of the customer is also determined by combining the data of the customer contour increase rate by the camera and the data of the amount of infrared rays.

  The customer information collection device 12 that has determined that the customer has approached the product sends more detailed content to the video display unit 22 and the speaker 27.

  In the sixth step, the customer contact determination unit 36 determines whether or not the customer picks up the product among the customers who have approached the customer information collection device 12 or the corresponding product 14 in the fifth step. This determination is recognized using data of both or one of the camera 17 and the infrared sensor 18.

  From the video captured by the camera 17, the characteristics of the product are input to the customer information device in advance, and it is determined that the customer has picked up that the product has been moved from the place where the product is installed.

  In addition, the amount of infrared rays emitted from the customer's hand is measured by the infrared sensor 18, and when both exceed a certain value, it can be determined that the infrared ray is taken by the hand. Moreover, it can also be judged that the customer has picked up from both values.

  The information displayed on the product information providing unit of the customer information collecting device 12 can be changed to more detailed information in accordance with the timing when the customer 11 approaches the product or picks up the product. Information that the customer wants to know can be pasted on the display unit surface and selected by the touch sensor. At this time, the content may be a predetermined content, or may be interactively flowed according to the customer's request indicated on the touch panel.

  In the seventh step, the product purchase determination unit 37 determines whether the product taken in the customer's hand in the sixth step has been purchased. This determination measures whether or not the product picked up by the hand captured by the camera is taken out of the range of the camera, and if it is taken out, determines that the customer has carried it for purchase. Alternatively, the customer's hand infrared may be measured with an infrared sensor, and the purchase / non-purchase of the product may be determined based on the presence or absence of sensing.

  Usually, the purchase is determined only by this processing. However, in order to further improve the accuracy of information, the determination may be made by obtaining POS data at the cash register.

In the eighth step, the behavior taken by the customer is classified into the following behavior patterns based on the above determination. Classification of these behavior patterns is performed by collecting all the data on a server.
(1) Go to the cash register in order to pick up the product and carry out the purchase procedure without acquiring the video display unit information and speaker information. (Customers who decided to purchase from the beginning)
(2) Even if the presence of the product is visually confirmed, the user does not show any interest in the contents of the video display unit and does not approach the product, and leaves there. (Customers who are not willing to purchase and have no interest at all)
(3) Visually confirm the existence of the product, start listening to the product information shown on the video display unit, and then pick up the product, return it to the original shelf, and leave it. (While there is no intention to purchase at first, there is interest, but customers who do not make a purchase decision)
(4) Visually confirm the presence of the product, start listening to the product information shown on the video display unit, and then go to the cash register to pick up the product and perform the purchase procedure. (Customers who did not intend to purchase but decided to purchase based on the product description shown on the video display)
(5) Visually confirm the existence of the product, start listening to the product information shown on the video display unit, then pick up the product, touch the touch panel 6 to obtain more detailed information, and purchase procedure as it is Go to the cashier to do. (Although there is no intention to purchase at first, customers who have actively obtained detailed explanations of the products shown on the video display and information they wanted to know and then decided to purchase)

Effects of this example

  According to the present invention according to the present embodiment, it is possible to obtain customer interest information by a conventional method using a questionnaire including customers who have not purchased.

  According to the present invention according to the present embodiment, there is no need for the customer's extra time, which is a problem with the conventional method using a questionnaire, and therefore the number of customer responses is not reduced. Customer interest information can be obtained without changing the true feeling when answering a questionnaire.

  According to the present invention according to the present embodiment, depending on the individuality of the store clerk, which is a problem in the method in which humans observe the behavior of the customer in the store and the store clerk estimates why the customer does not purchase the product etc. You can get reliable and reliable customer decision information, and you can easily increase the amount of information just by increasing the number of devices installed in the store, without the need to mobilize many people, It became possible at low cost.

  In addition, with a POS register that can acquire information on the sale of products and a system that captures the appearance of customers at the time of purchase with a camera, data consisting of attributes of purchased customers can be obtained, but customers who have not purchased However, in the embodiment of the present invention, how many customers did not purchase, what was the reason, and how much customers purchased It is possible to obtain data related to customer judgment interest information, such as whether he / she has lost his decision or what kind of specifications he / she has decided to purchase.

  In addition, the behavior of the customer in front of the store or the product field in the store is photographed with a camera or the like, tracking data including the customer's residence time is obtained from this video information, and sales promotion of the product in the store is obtained from these data. The customer has made a decision to purchase or not purchase the product, which is higher quality information that could not be obtained by the system to be used for the customer. It is possible to obtain high-quality customer judgment interest information such as whether you are interested in such specifications and features, and what specifications and features you do not like.

DESCRIPTION OF SYMBOLS 11 Customer 12 Customer information collection device 13 Passage 14 Corresponding product 15 Other product 16 Product shelf 17 Camera 18 Infrared sensor 21 PC part (PC part)
22 Video display unit 26 Touch screen 27 Speaker 28 Microphone 31 Product information providing unit 32 Passenger number of people counting unit 33 Customer visibility determining unit 34 Customer attribute estimating unit 35 Customer approach determining unit 36 Product contact determining unit 37 Product purchase determining unit 41 With camera Captured video screen 51 Eye feature point 52 Nose feature point 53 Mouth feature point 54 Facial contour feature point 61 Approaching customer eye feature 62 Approaching customer nose feature point 63 Approaching customer nose feature 63 Mouth feature 64 Mouth customer's facial contour feature 71 Customer's hand stretched on product shelf 91 Network 92 Customer information collection device at each store 93 Server

Claims (19)

  Product information for creating information on products to be provided to customers in a PC portion that is a part of the customer information collection device in a customer information collection device installed adjacent to the product on a product shelf installed in a store A providing unit, a passing customer number counting unit that counts the number of customers passing through the passage in front of the product shelf, and a screen of the video display unit of the customer information collecting device when the customer passing through the passage in front of the product shelf A customer visibility judging unit for judging that the customer has visually recognized, a customer attribute estimating unit for estimating an attribute of the customer visually recognized in the previous term, and a customer visually recognized in the previous term are installed adjacent to the customer information collecting device or the customer information collecting device. A customer approach judgment unit for judging that the product is approaching, a product contact judgment unit for judging whether the approaching customer has picked up the installed product, and holding the product at a place for settlement. luck A product purchase determination unit for determining whether or not, a video display unit for displaying information provided by the product information providing unit, a camera for capturing video into a PC portion, and a sensor for recognizing a customer's hand Including customer information collection device.   The product information providing unit corresponds to at least one of the result of the customer visual recognition determination unit, the result of the customer attribute estimation unit, the result of the customer approach determination unit, the result of the product contact determination unit, The customer information collecting apparatus according to claim 1, wherein contents to be provided are changed interactively.   A customer visual recognition determination unit that determines whether a customer visually recognizes a screen of a video display unit that displays the information provided by the product information providing unit, extracts feature points of the customer's face from the video information captured by the camera The customer information collection device according to claim 1, further comprising: a feature point extraction unit; and a customer face confrontation determination unit that determines whether the customer is facing the product from the movement of the feature point.   The customer attribute estimation part which estimates a customer's sex and an age group from the feature point of the customer's extracted face visually recognized by the said customer visual recognition judgment part and the outline shape of a customer's face is included. Customer information collection device.   The customer approach determining unit determines that the customer has approached when the contour shape of the customer captured from the video information photographed by the camera exceeds a predetermined value from the initial shape. The customer information collection device described.   The customer information collection device has a Doppler sensor in the periphery of the video display unit, and the customer approach determination unit determines that the approach has occurred due to the Doppler amount detected by the Doppler sensor exceeding a certain value. The customer information collecting apparatus according to claim 1.   The product contact determination unit is configured such that when the amount of infrared rays detected by the infrared sensor exceeds a certain value by an infrared sensor attached to a peripheral portion of the video display unit, the customer's hand contacts the corresponding product. The customer information collection device according to claim 1, wherein the customer information collection device is determined.   The product contact determination unit extracts a feature point of a customer's hand captured from video information photographed by the camera, and determines that the customer's hand contacts the corresponding product. 1. The customer information collecting apparatus according to 1.   The customer information collection device has a microphone in the periphery of the video display unit, and the product contact determination unit is configured to detect the customer's contact when the sound when the customer touches the product exceeds a certain value. 2. The customer information collecting apparatus according to claim 1, wherein it is determined that the hand and the corresponding product are in contact with each other.   The customer information collection device is connected to a pressure sheet that senses the pressure installed under the product placed on the product shelf, and the product contact determination unit has a pressure amount felt by the pressure sheet falls below a certain value. 2. The customer information collecting apparatus according to claim 1, wherein it is determined that the customer's hand is in contact with the corresponding product.   The product purchase determination unit determines that the customer has carried the product to the cash register for purchase procedure when the value of the infrared sensor determined that the product is in contact with the customer's hand has not increased again. 8. The customer information collecting apparatus according to claim 7.   The product purchase determination unit captures the product taken by the customer with the camera, and determines that the product has been carried to the cash register for purchase procedure by moving the product out of the screen. The customer information collecting apparatus according to claim 1, wherein:   The product purchase determination unit determines that when the pressure amount felt by the pressure sensor of the pressure sheet laid under the product falls below a certain value and does not return within a certain time, the customer 11. The customer information collecting apparatus according to claim 10, wherein it is determined that the item has been carried to a cash register for purchase procedure.   The customer information collection device according to any one of claims 1 to 13 is installed in a plurality of stores and is installed in a plurality of stores, each connected via a network, and information on all stores Customer information collection system that collects and analyzes data.   A step of showing information related to the product to the customer who is passing through the passage before the product display by a video display unit attached to the customer information collecting device, a step of counting the number of customers in the passage, and attached to the customer information collecting device A step of judging that the corresponding product installed on the screen or in the vicinity of the video display unit has been visually recognized, a step of estimating the attribute of the visually recognized customer, and the visually recognized customer approaching the product information collecting device The step of determining that the product is close to the installed product, the step of determining whether the customer who has approached the product has picked up the product, and whether the product has been carried to the checkout location And a customer information collecting method.   16. The customer information collecting method according to claim 15, further comprising the step of displaying the contents of the screen of the video display unit by changing the contents of the screen of the video display unit to a screen having contents adapted to the estimated attribute.   16. The customer information collecting method according to claim 15, further comprising the step of displaying the approaching customer by changing the contents of the screen of the video display unit to a screen having contents adapted to the estimated attribute.   16. The customer information collection according to claim 15, further comprising the step of displaying the approaching customer in place of a screen selected by the customer using a touch panel installed on the surface of the screen of the video display unit. Method.   16. The method for collecting customer information according to claim 15, further comprising the step of changing the content of the screen of the video display unit to a screen with a different content for the customer who is determined to have picked up the corresponding product.

Images