JP2016035720A - Operation log recording program, operation log recording method, and terminal device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an operation log that can be specified to be for explanation or for individuals.SOLUTION: When recording an operation performed in a terminal device 30, the terminal device 30 determines whether or not it is ready to explain, to the other parties, information displayed on the terminal device 30 or information stored in the terminal device 30, and records a result of the determination.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an operation log recording program, an operation log recording method, and a terminal device.

  An information exchange service has been built in which terminals and devices are connected at the place where people gather to share screens and collaborate. As an example, such information exchange services include nurses handing over or sending out matters to be sent and received at hospitals, sharing content related to materials through meetings, and teachers and students sharing content related to teaching materials at schools to collaboratively learn. It is effectively used in various scenes such as. When a meeting such as a meeting or a class is made through the information exchange service in this way, an operation log performed during the meeting may be recorded on the terminal.

JP 2013-105471 A JP 2009-64275 A JP 2006-155431 A JP 2007-27918 A

  However, in the above technique, it may not be possible to specify whether the recorded operation log is an operation to be shown to the other party or an operation performed for itself.

  In one aspect, an object of the present invention is to provide an operation log recording program, an operation log recording method, and a terminal device that can provide an operation log that can be specified for explanation or personal use.

  The operation log recording program of one aspect is a state in which information displayed on the terminal device or information stored on the terminal device is explained to the other party when an operation performed on the terminal device is recorded on the terminal device It is determined whether or not, and processing for recording the determined result is executed.

  It is possible to provide operation logs that can be specified for explanation or individual use.

FIG. 1 is a diagram illustrating the configuration of the information exchange system according to the first embodiment. FIG. 2 is a block diagram illustrating a functional configuration of the terminal device according to the first embodiment. FIG. 3 is a diagram illustrating an example of a camera image. FIG. 4 is a diagram illustrating an example of a camera image. FIG. 5 is a diagram illustrating an example of a gripping state of the terminal device. FIG. 6 is a diagram illustrating an example of a gripping state of the terminal device. FIG. 7 is a diagram illustrating an example of a gripping state of the terminal device. FIG. 8 is a diagram illustrating an example of a gripping state of the terminal device. FIG. 9 is a diagram illustrating an example of an operation log. FIG. 10 is a flowchart illustrating the procedure of the state recording process according to the first embodiment. FIG. 11 is a flowchart illustrating the procedure of the operation log recording process according to the first embodiment. FIG. 12 is a schematic diagram illustrating an example of a computer that executes an operation log recording program according to the first and second embodiments.

  Hereinafter, an operation log recording program, an operation log recording method, and a terminal device according to the present application will be described with reference to the accompanying drawings. Note that this embodiment does not limit the disclosed technology. Each embodiment can be appropriately combined within a range in which processing contents are not contradictory.

[System configuration]
FIG. 1 is a diagram illustrating the configuration of the information exchange system according to the first embodiment. The information exchange system 1 shown in FIG. 1 provides an information exchange service for screen sharing and collaborative work by connecting the terminal devices 30 to each other via the server device 10 on the spot where users of the terminal devices 30 gather. To do. As part of the information exchange service, the information exchange system 1 executes an operation log recording service for recording an operation log that can be specified for explanation or personal use during the execution of the information exchange service.

  As shown in FIG. 1, the information exchange system 1 accommodates a server device 10 and terminal devices 30 </ b> A to 30 </ b> N. Hereinafter, the terminal devices 30A to 30N may be collectively referred to as “terminal device 30”.

  The server device 10 and the terminal device 30 can communicate with each other via any type of communication network such as a LAN (Local Area Network), a VPN (Virtual Private Network), or the Internet (Internet), regardless of wired or wireless. Connected to.

  The server device 10 is a computer that provides the information exchange service. That is, the server apparatus 10 can be implemented by installing an information exchange program for realizing the above information exchange service as package software or online software on a desired computer.

  As an embodiment, the server device 10 can have both functions of a wireless LAN access point such as Wi-Fi (registered trademark) and a Web server that provides the information exchange service. As a result, for example, a small server with an access point function can be installed in any place where people can gather, not just in places where meetings such as hospitals, corporate meeting rooms, and classrooms are easily held. As a result of providing the information exchange service, the initial cost of the service provider can be reduced. As another embodiment, the server device 10 has functions of a wireless LAN access point and a Web server that provides an authentication service for authenticating the terminal devices 30 to be grouped as a basis for providing the information exchange service. It can also be a front end. In this case, the information exchange service described above can be provided to other web servers or backends such as cloud computing.

  The terminal device 30 is a computer that receives the information exchange service.

  As an embodiment, the terminal device 30 can employ a tablet-type information processing terminal, so-called a tablet terminal. This is merely an example of an implementation form. For example, as the terminal device 30, a mobile communication terminal represented by a smartphone, a mobile phone, a PHS (Personal Handyphone System), or the like can be adopted, and a notebook personal computer can also be adopted. In addition, the terminal device 30 is not limited to a portable terminal device such as a tablet terminal or a mobile communication terminal, and may be implemented as a fixed terminal such as a personal computer.

  Here, as an example of a group forming method of the terminal device 30, a case where a BLE (Bluetooth (registered trademark) Low Energy) chip mounted on the terminal device 30 is used is illustrated. For example, by burying address information such as the IP address of the server device 10 in an advertising packet broadcasted by the BLE-compatible terminal device 30, a connection request for the server device 10 is sent to another terminal device 30 existing within the communication range of the BLE chip. Can be sent. Although the case where the terminal device 30 broadcasts the BLE advertising packet in which the address information such as the IP address of the server device 10 is embedded is illustrated here, the terminal device 30 is not necessarily the device that broadcasts the BLE advertising packet. It does not matter. For example, an advertising-specific BLE module that broadcasts an BLE advertising packet in which address information such as the IP address of the server device 10 is embedded may be provided in a predetermined place such as a conference room or a classroom.

  Specifically, when the BLE function is set to ON in the terminal device 30, the terminal device 30 sends the IP address of the server device 10 as an entry request to a conference opened by the user, for example, a meeting or a class. The advertising packet in which the address information is embedded is broadcast. At this time, if an application program for information exchange service for the terminal is installed in the terminal device 30, the entry request including setting the BLE function to the ON state is not necessarily required to manually set the BLE function to the ON state. Can be automated. For example, the application program described above can automatically transmit an entry request to the terminal device 30 when the time is within a predetermined period based on the time registered in the schedule in conjunction with the scheduler or the like. In addition, the above application program, in conjunction with a GPS (Global Positioning System) receiver or the like, sends an entry request to the terminal device 30 when the position of the terminal device 30 is included in a predetermined place such as a conference room or a classroom. Can be sent automatically. In this case, the application program can transmit the entry request only when acceleration corresponding to the seating or the like is detected in conjunction with the motion sensor or the like.

  When the advertising packet is broadcast in this way, the terminal device 30 other than the starting terminal device 30 that has made the entry request accepts an input regarding whether or not to allow entry to the conference via a user interface (not shown). Then, when an input to enter the conference is made, the terminal devices 30 other than the originating terminal device 30 add the address information such as the MAC address of the originating terminal device 30 to the entry to the conference, that is, information exchange A connection request between the terminal devices 30 that can be called a service start request is transmitted to the server device 10. Needless to say, the starting terminal device 30 also transmits an entry to the conference to the server device 10.

  Thereby, the server device 10 can bundle the entry to the conference from the terminal device 30 existing in the communication range of BLE, that is, the connection request between the terminal devices 30 by the MAC address of the terminal device 30 as the starting point. Thereafter, when the authentication of each terminal device 30 is successful according to the connection request from each terminal device 30, the server device 10 starts providing the information exchange service to each terminal device 30.

[Configuration of Terminal Device 30]
FIG. 2 is a block diagram illustrating a functional configuration of the terminal device 30 according to the first embodiment. As shown in FIG. 2, the terminal device 30 includes a touch panel 31, a communication unit 32, a camera 33, an acceleration sensor 34, a geomagnetic sensor 35, an OS (Operating System) execution unit 36, a determination unit 37, A first recording unit 38, a state storage unit 38a, a second recording unit 39, and an operation log storage unit 39a are provided. Here, since any of terminal apparatus 30A to terminal apparatus 30N may have the same functional configuration as the structural configuration shown in FIG. 2, it will be described as the functional configuration of terminal apparatus 30.

  The terminal device 30 may include various functional units included in a known computer in addition to the functional units illustrated in FIG. For example, when the terminal device 30 is implemented as a stationary information processing device, it may further include input / output devices such as a keyboard, a mouse, and a display. When the terminal device 30 is implemented as a mobile communication terminal, the terminal device 30 may further include a functional unit such as a GPS (Global Positioning System) receiver.

  The touch panel 31 is a displayable and inputable device.

  As one aspect regarding display, the touch panel 31 displays an image output by an OS or an application program executed on the terminal device 30. As one aspect regarding input, the touch panel 31 accepts touch operations such as taps, flicks, sweeps, pinch-ins, pinch-outs, and drag-and-drops performed on the screen of the touch panel 31. Here, the touch panel 31 is illustrated as an input device for inputting an instruction to the terminal device 30. However, the input device is not limited thereto, and further includes a physical key that realizes complementary input with the touch panel 31. It doesn't matter.

  The communication unit 32 is a processing unit that performs various types of communication with other devices, for example, the server device 10 and the other terminal devices 30.

  As an embodiment, the communication unit 32 communicates with an external terminal such as the server device 10 and the other terminal device 30 using at least one of wireless LAN, carrier, and BLE. For example, in the case of the BLE function, the communication unit 32 can accept an entry request for a conference from another terminal device 30 or can transmit an entry request for the conference to the other terminal device 30. In the case of a wireless LAN, the communication unit 32 can transmit and receive content such as a document, an image, and audio to another terminal device 30 via the server device 10 during execution of the information exchange service. Further, the communication unit 32 can upload the operation log to the server device 10 after the information exchange service is executed.

  The camera 33 is an imaging device that captures an image.

  As an embodiment, the camera 33 is mounted with an image sensor such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). For example, the camera 33 can be equipped with three or more light receiving elements such as R (red), G (green), and B (blue). As an example of mounting the camera 33, when there is a camera mounted from the time of shipment of the terminal device 30, such as an in camera or an out camera, the camera can be used.

  The acceleration sensor 34 is a sensor that detects acceleration. As an embodiment, the acceleration sensor 34 may be a triaxial acceleration sensor. Further, as the geomagnetic sensor 35, a triaxial geomagnetic sensor of pitch (X axis), roll (Y axis), and yaw (Z axis) can be adopted. A gyro sensor may be used instead of the geomagnetic sensor.

  The OS execution unit 36 is a processing unit that controls execution of an OS (Operating System).

  As one embodiment, the OS execution unit 36 detects various operations on the touch panel 31 and commands corresponding to the operations. For example, the OS execution unit 36 detects touch operations such as taps, flicks, sweeps, pinch-ins, pinch-outs, drag-and-drops, and handwriting input loci received on the touch panel 31, or commands in which the touch operations are interpreted. For example, it is possible to detect image download (reception) and upload (transmission) to the server device 10. The OS execution unit 36 can execute any kind of OS without depending on a specific architecture.

  When the determination unit 37 records an operation performed on the terminal device 30, whether or not the terminal device 30 is in a state of explaining information displayed on the touch panel 31 or information stored in the terminal device 30 to the other party. It is a processing part which determines. Hereinafter, the state explained to the other party may be referred to as “explanation state”, and the state that is not the explanation state may be referred to as “non-explanation state”.

  As one embodiment, the determination unit 37 uses the at least one of (A) camera image, (B) geomagnetic data, (C) acceleration data, and (D) content communication to indicate that the terminal device 30 is in the explanation state or non-existing state. It is determined whether it is in the explanation state. Below, although the case where comprehensive determination is performed using all of said four (A)-(D) is illustrated, determination can also be performed only in any one.

(A) Camera Image FIGS. 3 and 4 are diagrams illustrating an example of a camera image. 3 and 4 each illustrate a camera image captured by the in-camera 33a during execution of the information exchange service. As shown in FIGS. 3 and 4, when shooting with the in-camera 33 a, it is highly likely that a person browsing the screen of the touch panel 31 will be imaged. Actually, since the content is displayed on the touch panel 31, the camera image is captured in the background. For convenience of explanation, the camera image is displayed on the touch panel 31 in FIGS. To do.

  Here, as shown in FIG. 3, when only one person is captured by the in-camera 33a, the user of the terminal device 30 can explain to other members who participate in the conference. It is more likely that the user is browsing or operating the screen on which the content or the like is displayed on the touch panel 31 alone. Therefore, when there is one person shown in the camera image, it can be estimated that the state is not explained.

  On the other hand, as shown in FIG. 4, when two or more persons are captured by the in-camera 33 a, a plurality of persons are viewing the screen on which the content is displayed on the touch panel 31. There is a high possibility that the person is explaining while viewing the screen together with other members participating in the conference. Therefore, when there are a plurality of persons shown in the camera image, it can be estimated that the state is the explanation state.

  Therefore, the determination unit 37 recognizes the number of persons by executing image processing on the camera image. In addition, when the number of persons recognized from the camera image is one, the determination unit 37 temporarily estimates “non-explanatory state”, while the number of persons recognized from the camera image is plural. In some cases, a “description state” is temporarily estimated.

(B) Geomagnetic Data FIGS. 5 and 6 are diagrams illustrating an example of a gripping state of the terminal device 30. FIG. 5 shows a state in which the user of the terminal device 30 is gripped in a state of facing the touch panel 31, and FIG. 6 shows that the terminal device 30 is rotated vertically around the X axis, that is, in the roll direction from the state shown in FIG. Thus, a gripping state is shown in which the user of the terminal device 30 faces the back surface of the touch panel 31 and the other member who participates in the meeting facing the user of the terminal device 30 faces the touch panel 31. .

  As described above, when the screen is rotated vertically from the gripping state shown in FIG. 5 to the gripping state shown in FIG. 6, the content displayed on the touch panel 31 can be viewed by other members participating in the conference while viewing the content. There is a high possibility of explaining. Therefore, in this case, it can be estimated that the state is the explanation state.

  From this, the determination unit 37 determines whether or not the Y-axis orientation of the triaxial geomagnetic data acquired from the geomagnetic sensor 35 is reversed from a predetermined orientation, that is, vertically upward. At this time, when the Y-axis azimuth is inverted from the vertically upward direction, the determination unit 37 temporarily estimates the “description state” while the Y-axis azimuth is not inverted from the vertically upward direction. Is temporarily estimated as a “non-explanatory state”. Whether or not the above-described reversal is possible may be determined by determining whether or not the Y-axis orientation is within a predetermined range from the vertically downward direction.

(C) Acceleration Data FIGS. 7 and 8 are diagrams illustrating an example of a gripping state of the terminal device 30. 7 shows a state in which the user of the terminal device 30 is gripped in a state of facing the touch panel 31, and FIG. 8 shows that the user rotates the Y axis around the Y axis, that is, in the pitch direction from the state shown in FIG. Thus, a gripping state is shown in which the user of the terminal device 30 faces the back surface of the touch panel 31 and the other member who participates in the meeting facing the user of the terminal device 30 faces the touch panel 31. .

  As described above, when the tablet is horizontally rotated from the gripping state shown in FIG. 7 to the gripping state shown in FIG. 8, the content displayed on the touch panel 31 is displayed while other members participating in the conference browse the screen. There is a high possibility of explaining. Therefore, in this case, it can be estimated that the state is the explanation state.

  From this, the determination unit 37 determines whether the acceleration of either the X axis or the Z axis in the triaxial acceleration data acquired from the acceleration sensor 34 has changed over a predetermined threshold. At this time, when the acceleration of either the X-axis or the Z-axis has changed more than the threshold value, the determination unit 37 temporarily estimates the “explanation state”, while any of the X-axis and the Z-axis If the acceleration does not change more than the threshold, it is temporarily estimated as a “non-explanatory state”.

(D) Content communication When the terminal device 30 transmits content to the server device 10 during execution of the information exchange service, the user of the terminal device 30 distributes materials to other members participating in the conference. It is likely that you are trying to explain. Therefore, in this case, it can be estimated that the state is the explanation state. On the other hand, when the terminal device 30 receives content from the server device 10 during the execution of the information exchange service, the user of the terminal device 30 receives material from other members participating in the conference and explains the content. There is a high possibility of receiving. In this case, it can be estimated that the state is not explained.

  For this reason, the determination unit 37 determines whether or not the content communication log acquired from the OS execution unit 36 is a transmission log. At this time, when it is a transmission log, the determination unit 37 temporarily estimates a “description state”, whereas when it is a reception log, the determination unit 37 temporarily estimates a “non-description state”.

  After these determinations (A) to (D) are executed, the determination unit 37 determines whether or not the determination state is determined in any of the determinations (A) to (D). At this time, the determination part 37 considers it as an explanatory state, when it determines with it being an explanatory state in either of the determination of (A)-(D). On the other hand, when it is determined that any of the determinations (A) to (D) is in the non-explanation state, the determination unit 37 considers the state as the non-explanation state. As a result, a final comprehensive determination is made.

  The first recording unit 38 is a processing unit that records the determination result of the explanatory state or the non-explained state by the determination unit 37 in the state storage unit 38a.

  As an embodiment, the first recording unit 38 records the explanation state or the non-explanation state, which is the result of the comprehensive determination, in the state storage unit 38a every time the determination unit 37 makes a comprehensive determination. As described above, the state storage unit 38a stores the latest comprehensive determination result, that is, either the explanation state or the non-explanation state, every time the determination unit 37 makes a comprehensive determination.

  The second recording unit 39 is a processing unit that records an operation log in the operation log storage unit 39a.

  As an embodiment, the second recording unit 39 determines whether the state stored in the state storage unit 38a is the explanation state or the non-explanation state each time an operation is detected by the OS execution unit 36. . At this time, when the state stored in the state storage unit 38a is the explanation state, the second recording unit 39 provides information indicating that the operation or the operation corresponding to the operation is the explanation state or the explanation state. Record it as an operation log after associating it. On the other hand, when the state stored in the state storage unit 38a is the non-explanation state, the second recording unit 39 indicates that the operation or the operation corresponding to the operation is the non-explanation state or the non-explanation state. The information is associated and recorded as an operation log.

  Here, for the operation log stored in the operation log storage unit 39a, data in which items such as Time, Name, Action, Attribute, and Data are associated can be employed. Here, “Time” indicates the time when the operation or command is executed. “Name” indicates a user name of a user who has an account of the terminal device 30. “Action” indicates an operation and an operation corresponding to the operation, and includes, for example, tap, flick, sweep, pinch-in, pinch-out, drag & drop, handwriting input trajectory, and participation and exit to a conference. You can also “Data” refers to data related to the action, and includes, for example, content transmitted and received by the terminal device 30 and a locus of handwriting input. FIG. 9 is a diagram illustrating an example of an operation log. In the example of FIG. 9, it means that Taro Hashimoto has performed handwriting input at tt hour mm minute ss second on yyyy year mm month dd date. Furthermore, the operation log means a local log, that is, for personal use. According to this operation log, since the operation log is for personal use, it is possible to manage such that the disclosure range is narrower than the global log, that is, the operation log for explanation. In this example, the operation log for personal use is shown as an example. However, if the operation log is for explanation, it is possible to manage to expand the disclosure range compared to the operation log for personal use, contrary to this example. It is.

  The OS execution unit 36, the determination unit 37, the first recording unit 38, and the second recording unit 39 cause a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) to execute an operation log recording program. Can be realized. Each functional unit described above can also be realized by a hard wired logic such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

  Further, a semiconductor memory element or a storage device can be adopted for the state storage unit 38a and the operation log storage unit 39a. For example, examples of the semiconductor memory element include a flash memory, a dynamic random access memory (DRAM), and a static random access memory (SRAM). Further, examples of the storage device include storage devices such as a hard disk and an optical disk.

[Process flow]
Next, a processing flow of the terminal device 30 according to the present embodiment will be described. Here, after (1) the state recording process executed by the terminal device 30 is described, (2) the operation log recording process is described.

(1) Status Recording Process FIG. 10 is a flowchart illustrating the procedure of the status recording process according to the first embodiment. This process is repeatedly executed in the background from the time when the terminal device 30 joins the conference until it leaves the conference, that is, as long as the information exchange service is being performed.

  As shown in FIG. 10, the determination unit 37 acquires a camera image from the in-camera 33a (step S101A). Then, the determination unit 37 recognizes the number of persons by executing image processing on the camera image acquired in step S101A, and determines whether the number of persons is one (step S102A).

  At this time, when there are a plurality of persons recognized from the camera image (No in step S102A), the determination unit 37 temporarily estimates the “description state” (step S103A). On the other hand, when the number of persons recognized from the camera image is one (step S102A Yes), the determination unit 37 temporarily estimates the “non-explanatory state” (step S104A).

  In parallel with the processing in steps S101A to S104A, the determination unit 37 acquires triaxial geomagnetic data from the geomagnetic sensor 35 (step S101B). Then, the determination unit 37 determines whether or not the Y-axis orientation is reversed from the vertically upward direction among the three-axis geomagnetic data acquired in Step S101B (Step S102B).

  At this time, when the direction of the Y axis is reversed from the vertically upward direction (step S102B Yes), the determination unit 37 temporarily estimates the “explanation state” (step S103B). On the other hand, when the Y-axis azimuth is not reversed from the vertically upward direction (No at Step S102B), the determination unit 37 temporarily estimates a “non-explanatory state” (Step S104B).

  Further, in parallel with the processing of step S101B to step S104B, the determination unit 37 acquires triaxial acceleration data from the acceleration sensor 34 (step S101C). After that, the determination unit 37 determines whether the X-axis or Z-axis acceleration of the three-axis acceleration data acquired in step S101C has changed over a predetermined threshold (step S102C). ).

  At this time, if either the X-axis or Z-axis acceleration has changed by more than the threshold (Yes in step S102C), the determination unit 37 temporarily estimates the “description state” (step S103C). On the other hand, when neither the X-axis acceleration nor the Z-axis acceleration has changed by more than the threshold (No in step S102C), the determination unit 37 temporarily estimates a “non-explanatory state” (step S104C).

  Further, in parallel with the processing of step S101C to step S104C, the determination unit 37 acquires a content communication log from the OS execution unit 36 (step S101D). Then, the determination unit 37 determines whether or not the content communication log acquired in step S101D is a transmission log (step S102D).

  At this time, if the log is a transmission log (step S102D Yes), the determination unit 37 temporarily estimates the “description state” (step S103D). On the other hand, when it is a reception log (step S102D No), the determination unit 37 temporarily estimates a “non-explanatory state” (step S104D).

  And the determination part 37 determines whether it was estimated that it was an explanatory state in either of said estimation (A)-(D) (step S105). At this time, when it is estimated that it is in the explanation state in any of the estimations of (A) to (D) (Yes in step S105), the determination unit 37 finally comprehensively determines that it is in the explanation state. (Step S106).

  On the other hand, when it is determined that any of the estimations of (A) to (D) is in the non-explanation state (No in step S105), the determination unit 37 finally comprehensively determines that it is in the non-explanation state ( Step S107).

  Thereafter, the first recording unit 38 records the result of the comprehensive determination in step S106 or step S107 in the state storage unit 38a (step S108), and ends the process.

(2) Operation Log Recording Process FIG. 11 is a flowchart illustrating a procedure of an operation log recording process according to the first embodiment. This process is also repeatedly executed in the background as long as the information exchange service is being performed, similarly to the state recording process shown in FIG.

  As shown in FIG. 11, when an operation is detected by the OS execution unit 36 (step S301 Yes), the second recording unit 39 indicates that the state stored in the state storage unit 38a is in the explanatory state or the non-explained state. Is determined (step S302).

  Here, when the state stored in the state storage unit 38a is the explanation state (step S302 Yes), the second recording unit 39 is in the explanation state or the explanation state for the operation or the operation corresponding to the operation. Is recorded as an operation log (step S303).

  On the other hand, when the state stored in the state storage unit 38a is the non-explanation state (No in step S302), the second recording unit 39 is in the non-explanation state or the non-explanation state for the operation or the operation corresponding to the operation. Information indicating that there is an association is recorded as an operation log (step S304).

  After executing the process in step S303 or step S304, the process returns to step S301, and the processes from step S301 to step S304 are repeated.

[One aspect of effect]
As described above, whether or not the terminal device 30 according to the present embodiment is in a state where the display data or the recording data of the terminal device 30 is described with respect to the other party when the operation performed on the terminal device 30 is recorded. And record the result of the determination. Therefore, according to the terminal device 30 according to the present embodiment, it is possible to provide an operation log that can specify for explanation or for personal use.

  Although the embodiments related to the disclosed apparatus have been described above, the present invention may be implemented in various different forms other than the above-described embodiments. Therefore, another embodiment included in the present invention will be described below.

[Application example]
In the first embodiment, the case where the operation log is recorded by associating the operation with the explanation state or the non-explanation state every time an operation is detected is illustrated. However, the operation log can be recorded by another method. . For example, the start and end of at least one of the explanation state and the non-explanation state is recorded in the state storage unit 38a, and the operation time is set to the explanation state or the non-explanation state based on the start and end periods. The explanation state or the non-explanation state may be associated with the operation depending on whether or not it corresponds.

[Distribution and integration]
In addition, each component of each illustrated apparatus does not necessarily have to be physically configured as illustrated. In other words, the specific form of distribution / integration of each device is not limited to that shown in the figure, and all or a part thereof may be functionally or physically distributed or arbitrarily distributed in arbitrary units according to various loads or usage conditions. Can be integrated and configured. For example, the determination unit 37, the first recording unit 38, or the second recording unit 39 may be connected as an external device of the terminal device 30 via a network.

[Operation log recording program]
The various processes described in the above embodiments can be realized by executing a prepared program on a computer such as a personal computer or a workstation. In the following, an example of a computer that executes an operation log recording program having the same function as that of the above embodiment will be described with reference to FIG.

  FIG. 12 is a schematic diagram illustrating an example of a computer that executes an operation log recording program according to the first and second embodiments. As illustrated in FIG. 12, the computer 100 includes an operation unit 110a, a speaker 110b, a camera 110c, a display 120, and a communication unit 130. Further, the computer 100 includes a CPU 150, a ROM 160, an HDD 170, and a RAM 180. These units 110 to 180 are connected via a bus 140.

  As shown in FIG. 12, the HDD 170 has an operation log recording program 170a that performs the same functions as those of the determination unit 37, the first recording unit 38, and the second recording unit 39 described in the first embodiment. Remembered. The operation log recording program 170a may be integrated or separated as appropriate, like the components of the determination unit 37, the first recording unit 38, and the second recording unit 39 shown in FIG. That is, not all data stored in the HDD 170 may be stored in the HDD 170, and only data used for processing may be stored in the HDD 170.

  Then, the CPU 150 reads the operation log recording program 170 a from the HDD 170 and expands it in the RAM 180. Accordingly, as shown in FIG. 12, the operation log recording program 170a functions as an operation log recording process 180a. The operation log recording process 180a expands various data read from the HDD 170 to an area allocated to the operation log recording process 180a on the RAM 180, and executes various processes based on the expanded various data. The operation log recording process 180a includes processes executed by the determination unit 37, the first recording unit 38, and the second recording unit 39 shown in FIG. 2, for example, the processes shown in FIGS. In addition, all the processing units virtually realized on the CPU 150 do not necessarily have to operate on the CPU 150, and only the processing units used for processing need only be virtually realized.

  Note that the operation log recording program 170a is not necessarily stored in the HDD 170 or the ROM 160 from the beginning. For example, each program is stored in a “portable physical medium” such as a flexible disk inserted into the computer 100, so-called FD, CD-ROM, DVD disk, magneto-optical disk, or IC card. Then, the computer 100 may acquire and execute each program from these portable physical media. In addition, each program is stored in another computer or server device connected to the computer 100 via a public line, the Internet, a LAN, a WAN, etc., and the computer 100 acquires and executes each program from these. It may be.

DESCRIPTION OF SYMBOLS 1 Information exchange system 10 Server apparatus 30 Terminal apparatus 31 Touch panel 32 Communication part 33 Camera 33a In-camera 34 Acceleration sensor 35 Geomagnetic sensor 36 OS execution part 37 Judgment part 38 1st recording part 38a State memory part 39 2nd recording part 39a Operation log storage

Claims (7)

On the terminal device,
When recording an operation performed on the terminal device, it is determined whether or not the information displayed on the terminal device or information stored in the terminal device is in a state of being explained to the other party.
An operation log recording program characterized by causing a process to record a determination result to be executed. In the terminal device,
Further executing a process of acquiring an image captured by a camera mounted on the terminal device,
2. The determination process according to claim 1, wherein the determination process determines whether or not a state is to be explained to the other party based on whether or not the number of persons included in the image is one or more. Operation log recording program. In the terminal device,
Further executing a process of acquiring geomagnetic data related to the terminal device,
The determining process determines whether or not the terminal device is in a state of explaining to the other party based on whether or not the orientation of the terminal device is reversed from a predetermined orientation based on geomagnetic data related to the terminal device. The operation log recording program according to claim 1. In the terminal device,
And further executing a process of acquiring triaxial acceleration data related to the terminal device,
The determination process determines whether or not it is a state to be explained to the other party based on whether or not the acceleration of any two predetermined axes among the three axes acceleration data related to the terminal device is equal to or greater than a predetermined threshold. The operation log recording program according to claim 1, wherein: In the terminal device,
Further execute the process of acquiring the communication log of the content,
2. The operation log according to claim 1, wherein the determining process determines whether or not the content communication log is in a state to be explained to the other party depending on whether the communication log of the content is a transmission log or a reception log. Recording program. The terminal device
When recording an operation performed on the terminal device, it is determined whether or not the information displayed on the terminal device or information stored in the terminal device is in a state of being explained to the other party.
An operation log recording method characterized by executing a process of recording the determined result. A determination unit that determines whether or not information displayed on the terminal device or information stored on the terminal device is in a state of being explained to the other party when the operation performed on the terminal device is recorded;
And a recording unit that records the result of the determination.

Images