JP2008131412A - Video telephone system and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To control information to be transmitted to a communicating party in an environment unsuitable for a video telephone. <P>SOLUTION: A CPU 11 acquires a current environmental status during TV telephone communication and compares it with regulation conditions in a regulation condition table CC to determine whether the environment is unsuitable for a TV telephone and if the environment is unsuitable, transmission to a communicating party is controlled. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a videophone device and a program for transmitting a camera-captured image and input sound during telephone communication with a communication partner.

2. Description of the Related Art Conventionally, a cellular phone device that performs videophone communication by transmitting an image captured by a camera to a communication partner is known (see Patent Document 1). In addition, a technique is known in which a background portion is cut from a camera-captured image and a person portion is transmitted according to a communication partner or a call time zone (see Patent Document 2).
Japanese Patent Laid-Open No. 2005-73080 JP 2006-13856 A

  By the way, in a mobile phone device with a videophone function, the surrounding environment changes every moment as it moves, so it is not known where the videophone is used. There is a case where a call is received from the other party even in a place where privacy is to be maintained or in a place unsuitable for a videophone such as in a car. In such a case, according to Patent Document 2 described above, since the background portion can be cut and transmitted, it is effective in terms of privacy protection, but it is a technology based on a communication partner or a call time zone. there were.

  An object of the present invention is to control information transmitted to a communication partner in an environment unsuitable for a videophone.

The invention according to claim 1 is a videophone device that transmits a captured image captured by a camera and telephone-input voice input during a telephone communication with a communication partner, as a transmission control condition for controlling transmission to the communication partner. The condition storage means for storing and managing the environmental situation, the acquisition means for acquiring the current environmental situation at the time of telephone communication, and the current environmental situation obtained by this acquisition means and the transmission control condition are compared with each other for the videophone. A determination unit for determining whether or not the environment is inappropriate, and a captured image and input sound transmitted to the communication partner when the determination unit determines that the environment is inappropriate for a videophone. And a control means for controlling at least one of them.
Furthermore, a program for realizing the main functions shown in the invention described in claim 1 is provided to the computer (the invention described in claim 12).

The invention described in claim 1 described above may be as follows.
In a state where position information of a specific location is stored and managed as the transmission control condition in advance, the acquisition unit acquires current position information during telephone communication, and the determination unit determines that the current position information is the transmission control condition. Whether or not the environment is inappropriate for a videophone is determined based on whether or not the above conditions are satisfied (invention of claim 2).

  In a state where a background part in a photographed image photographed with a specific place as a background is stored and managed as the transmission control condition, the acquisition unit obtains a background part from the current photographed image photographed during telephone communication, The determination means determines whether or not the environment is inappropriate for a videophone based on whether or not the background portion acquired from the current photographed image and the transmission control condition are characteristically matched. (Invention of Claim 3)

  In a state where ambient brightness information is stored and managed in advance as the transmission control condition, the acquisition unit acquires the current brightness information during telephone communication, and the determination unit includes the current brightness information and the transmission. By comparing the control conditions, it is determined whether or not the environment is inappropriate for the videophone (the invention according to claim 4).

  In a state where ambient sound information is stored and managed in advance as the transmission control condition, the acquisition unit acquires current ambient sound information during telephone communication, and the determination unit includes the current ambient sound information and the transmission control condition. To determine whether or not the environment is inappropriate for a videophone (the invention according to claim 5).

When the determination unit determines that the environment is inappropriate for a videophone, the control unit changes either the photographed image or the input sound (the invention according to claim 6).
In this case, when changing the photographed image, any one of an image processing process for specifying the background part and processing the part, and an alternative process for replacing the photographed image with a registered image registered in advance is performed. You may make it perform (invention of Claim 7).

  When it is determined by the determination means that the environment is inappropriate for a videophone, the control means prohibits transmission of either a photographed image or input sound (the invention according to claim 8).

  A determining means for determining whether or not the other party is a registered partner registered in advance during telephone communication is provided, and according to the determination result by the determining means, the control means includes at least the captured image and the input voice. Either one is controlled (the invention according to claim 9).

  The condition storage unit stores and manages transmission control conditions for each control type in association with a plurality of control types indicating how to control a captured image or input sound, and the determination unit includes the acquisition unit. As a result of comparing the current environmental situation obtained by the above and the transmission control condition for each control type, it is determined whether or not the environment is inappropriate for a videophone based on whether any of the conditions is met. (Invention of Claim 10)

  When a change in the transmission control condition is instructed by the user, the current environmental situation obtained by the acquisition unit is set as the transmission control condition (the invention according to claim 11).

  The present invention can control information to be transmitted to a communication partner in an environment unsuitable for a videophone, and can maintain privacy protection, security management, etc. without performing a special operation.

Hereinafter, embodiments of the present invention will be described with reference to FIGS.
This embodiment exemplifies a case where the present invention is applied to a mobile phone device with a TV phone function as a TV (TV) phone device, and FIG. 1 is a block diagram showing a communication network system.
The mobile phone device 1 is connected to the mobile phone device 1 on the other side via a mobile radio network (public mobile communication network) 2 from the nearest base station or exchange, and further on the other side via the Internet 3. It can be connected to a PC (personal computer) 4 or a fixed telephone 5 with an IP (Internet Protocol) telephone function. The mobile phone device 1 has a voice phone function for sending and receiving voice data and a phone call function for sending and receiving real-time images in addition to voice, and can make a video phone call with the other party. It has become. Further, the mobile phone device 1 is provided with a voice phone function, a video phone function, an electronic mail function, an Internet connection function, and the like.

FIG. 2 is a block diagram showing basic components of the cellular phone device 1 with a TV phone function.
The CPU 11 is a central central processing unit that controls the overall operation of the mobile phone device according to various programs in the storage unit 12. The storage unit 12 is an internal memory, and has a program area and a data area. In this program area, a program for realizing the present embodiment according to an operation procedure shown in FIGS. In addition, a restriction condition table CC, a restriction type table CK, and an address book AD, which will be described later, are stored in the data area. The recording medium 13 is a detachable portable memory that supplies various data programs externally, and is constituted by, for example, an SD card, an IC card, or the like. The memory 14 is an internal memory having a work area, and various data in the memory 14 is saved in the storage unit 12 as necessary. In the work area of the memory 14, a “regulation flag”, a “setting flag”, etc., which will be described later, are temporarily stored.

  The telephone communication unit 15 takes in a signal from the reception side of a transmission / reception unit (baseband unit) connected to an antenna that constitutes a radio unit, demodulates it into a reception baseband signal, and then receives a reception speaker via the acoustic control unit 16. The sound is output from 17. In addition, the telephone communication unit 15 takes in the input voice from the transmission microphone 18 from the acoustic control unit 16, encodes it into a transmission baseband signal, gives it to the transmission side of the transmission / reception unit, and transmits and outputs it from the antenna. The transmission microphone 18 is also used as a sensor for detecting ambient sounds, and the CPU 11 specifies the current environment based on the detection result of the transmission microphone 18 during videophone communication. ing. On the other hand, a real-time image (for example, the face image of the other party) received and acquired via the telephone communication unit 15 by the TV phone function is given to the main display unit 20 such as an LCD (liquid crystal display device) via the display control unit 19. Is displayed and output. The sub display unit 21 displays and outputs the current date and time, simple messages, icons, and the like.

  The in-camera 22 is a camera imaging unit for a videophone that captures a face of the user, and, for example, two casings (an operation unit casing and a display unit casing) constituting the cellular phone device can be opened and closed ( When the two cases are opened, the lens system is arranged inside the display unit case (display screen side) so as to face the user (photographer). ing. The CPU 11 acquires a photographed image from the in-camera 22 at the time of videophone communication, and specifies what kind of environment is currently present based on the background portion. The in-camera 22 includes a distance measuring sensor, a light amount sensor, an analog processing circuit, a signal processing circuit, a compression / expansion circuit, etc. in addition to a photographing lens, a lens / mirror block such as a mirror, an image sensor, and its drive system. In addition to adjusting and controlling the zoom, it controls drive control during autofocus, shutter drive control, exposure, white balance, and so on.

  The key operation unit 23 performs dial input, character input, command input, and the like, and the CPU 11 executes processing according to a key input signal from the key operation unit 24. The notification unit 24 includes a speaker for notification of incoming call notification, an LED (light emitting diode), and a vibration motor. The notification unit 24 is driven at the time of incoming call / mail, and is also driven at the time of alarm notification. A GPS (Global Positioning System) receiving unit 25 obtains the current position (latitude and longitude) using a satellite and a ground control station, and the CPU 11 receives the current position from the GPS receiving unit 25 during videophone communication. To identify the current environment. The illuminance sensor 26 detects ambient brightness with a sensitivity close to that of the human eye during videophone communication, and the CPU 11 determines the current environment based on the detection result of the illuminance sensor 26. I try to identify.

FIG. 3 is a diagram for explaining the regulation condition table CC.
The restriction condition table CC is a table for restricting the transmission under certain conditions when transmitting a photographed image taken by a camera at the time of videophone communication and an input sound input by a microphone. That is, the restriction condition table CC stores and manages transmission restriction conditions for restricting transmission of videophones for each restriction type. A plurality of restriction types “background change”, “pre-registration”, “no image”, “ For each “no sound”, a plurality of environmental conditions “location”, “background”, “brightness”, and “ambient sound” are stored. In this case, “Location”, “Background”, “Brightness”, “Ambient sound” are arranged in the horizontal direction (column direction), “Background change”, “Pre-registration”, “No image”, “No sound” In a matrix-like table in which are arranged in the vertical direction (row direction), a restriction condition is arbitrarily set in the cell.

  The plurality of types of environmental situations indicate an environment that is inappropriate for a TV phone. For example, “location” includes location information (longitude / latitude information) of a location arbitrarily registered in advance such as a private location such as a home. ) Is set. In “Background”, a photographed image of the place is set in advance in order to identify the current location by using the background in the photographed image taken during the videophone communication as a clue. For example, a photographed image obtained by photographing a security-managed room such as a company in advance is set as the background image. “Brightness” is set in advance, for example, brightness information measured in an arbitrary place such as indoor brightness. For example, “brightness” has a width such as “25 to 35” looks. Is set.

  “Ambient sound” is volume information recorded in advance at an arbitrary location such as noise in a cafeteria during lunch breaks. For example, it has a width of 40 to 70 decibels. The “place”, “background”, “brightness”, and “ambient sound” can be arbitrarily set for each regulation type, for example, “place change” is set to “background change”. Set multiple restriction locations such as setting transmission restriction conditions “A”, “B”, “C” correspondingly, and setting transmission restriction conditions “X”, “Y” corresponding to “background”. The transmission restriction condition can be arbitrarily set, but of course, “no setting” may be set.

  At the time of videophone communication, the CPU 11 obtains the current position from the GPS receiver 25, and if it corresponds to any “place” in the restriction condition table CC, it corresponds to the restriction type corresponding to this “place”. Controls the transmission of videophones. Similarly, the CPU 11 acquires the background portion from the photographed image photographed by the in-camera 22 at the time of videophone communication, and if it corresponds to any “background” in the regulation condition table CC, this “ If the transmission of the TV phone is controlled according to the regulation type corresponding to “background”, the ambient brightness is acquired from the illuminance sensor 26, and if it corresponds to any “brightness” in the regulation condition table CC The transmission of the TV phone is controlled according to the regulation type corresponding to this “brightness”, the ambient sound is acquired from the transmission microphone 18, and it corresponds to any “ambient sound” in the regulation condition table CC. If so, the transmission of the TV phone is controlled in accordance with the restriction type corresponding to the “ambient sound”.

  “Background change” is instruction information for executing a background change process for replacing a background portion in a captured image taken by the in-camera 22 during videophone communication with another background image prepared in advance. “Pre-registration” is instruction information for executing an image change process for transmitting a registered image registered in advance as an alternative to a captured image captured by the in-camera 22 at the time of videophone communication. “No image” is instruction information for executing an image cut process in which only an input sound from the transmission microphone 18 is transmitted without transmitting a captured image captured by the in-camera 22 at the time of videophone communication. “No sound” is instruction information for executing an audio cut process in which only the captured image captured by the in-camera 22 is transmitted without transmitting the input sound from the transmission microphone 18.

FIG. 4 is a diagram for explaining the restriction type table CK.
The restriction type table CK stores and manages a registered image (an image for changing a photographed image) that is arbitrarily registered in advance. The restriction type table CK corresponds to the restriction type “background change” and “pre-registration”. “Registered image” is stored. In this case, the “registered image” corresponding to “background change” is an image to be combined with the captured image, that is, an image serving as a background of a person, for example, a mosaic image, an in-office image, or the like. A “registered image” corresponding to “pre-registration” is an image that is a substitute for a captured image, and is, for example, a person's formal image, a pet image, or the like. The “registered image” is not limited to a still image but may be a moving image such as an animation.

FIG. 5 is a diagram for explaining the address book AD.
The address book AD stores and manages the address book data for each destination. Each record includes “name”, “phone number”, “permission flag”, for example, “address”, “ The configuration includes items such as “face image” and “mail address”. The “permission flag” is a flag indicating that the other party is not subject to restriction during videophone communication. In other words, even in an environment where transmission is restricted, a flag indicating that a normal telephone response (transmission as usual) is permitted for a party whose “permission flag” is set in the address book AD. For example, if the “permission flag” is set for the family and the best friend, the family and the best friend are not regulated.

  Next, the operation concept of the cellular phone device 1 in this embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. In addition, the operation according to the above-described program code transmitted via the transmission medium can be sequentially executed. In other words, in addition to the recording medium, an operation peculiar to this embodiment can be executed by using a program / data supplied externally via a transmission medium.

6 to 9 are flowcharts showing the overall operation of the mobile phone device 1 that is started to be executed when the power is turned on.
First, the CPU 11 operates the telephone communication unit 15 to perform standby processing for registering the current position (step S1), and enters a standby state for telephone / mail while reading out and displaying a predetermined standby image. (Step S2). In this state, when it is detected that there is no incoming call / mail (NO in step S2), the flow proceeds to the flow of FIG. 9 to check whether there is any operation (step S59). As a result, if any operation is not performed, the standby state is returned (step S1 in FIG. 6), but if any operation is performed (YES in step S59), it is checked whether the operation is a telephone call operation. (Step S60) If the operation is other than that, as processing corresponding to the operation, for example, a setting process for setting arbitrary data in the restriction condition table CC, the restriction type table CK, the address book A, a mail creation process, etc. After executing (Step S61), the process returns to the initial standby state (Step S1 in FIG. 6).

  If the incoming call is detected (YES in step S2), the CPU 11 obtains the other party's telephone number from the incoming signal, searches the address book AD based on this telephone number, and responds to the other party. Then, it is checked whether the “permitted flag” is set, that is, whether the incoming call is from a permitted party for which a normal telephone response is permitted (step S3). Move and instruct incoming notification with no restriction message. That is, the incoming call notification is performed while outputting a message indicating that the normal TV phone communication is possible.

  If the incoming call is from a party other than the permitted party (NO in step S3), the current environmental status is acquired, and it is determined whether or not transmission to the other party is restricted in an environment inappropriate for the TV phone. First, the CPU 11 activates the GPS receiving unit 25 to acquire the current position, and performs a place check process for searching the restriction condition table CC based on the current position (step S4). In this case, the “location” is accessed as the restriction type, and it is checked whether or not the current position matches any restriction condition. As a result, if any of the “locations” falls under the restriction condition (YES in step S5), it is determined that the environment is inappropriate for the TV phone, and the corresponding restriction type is placed in the work area of the memory 14. Temporary storage is performed (step S6). Then, in addition to setting a “restriction flag” indicating that the restriction condition is met (step S7), an incoming call notification with a restriction presence message is instructed (step S8). In this case, together with normal incoming call notification, a message indicating that transmission is restricted is output.

  If it is not a restricted place (NO in step S5), the in-camera 22 is activated to acquire the captured image (step S9), the background portion is extracted from the captured image, and the background portion is extracted. Then, a camera background check process for searching the restriction condition table CC is performed (step S10). In this case, the “background” is accessed for the restriction type, and it is checked whether the background portion extracted from the photographed image characteristically matches any restriction condition. In addition, it is not limited to whether or not they match as a whole, and even when they partially match, it may be determined that both match characteristically.

  For example, when a specific object is copied in the background portion, when the relative distance relationship between a plurality of objects is constant, it may be determined that the two characteristically match each other. As a result of such a check process, when any of the “background” is met and the regulation condition is satisfied (YES in step S11), it is determined that the environment is inappropriate for the video phone as in the above case. The corresponding restriction type is temporarily stored (step S12), the "restriction flag" is set (step S7), and an incoming call notification with restriction message is instructed (step S8).

  If none of the registered backgrounds corresponds (NO in step S11), the illuminance sensor 26 is activated to obtain the ambient brightness, and the brightness for searching the restriction condition table CC based on this brightness information. A length check process is performed (step S13). In this case, the “brightness” is accessed for the restriction type, and it is checked whether or not the measurement value of the illuminance sensor 26 meets any restriction condition. As a result, when any of the “brightness” conditions is satisfied (YES in step S12), the corresponding restriction type is temporarily stored (step S15), as in the case described above, and the “restriction flag” is set. "Is set (step S7), and an incoming call notification with a restricted message is instructed (step S8).

  Further, if none of the brightness levels are applicable (NO in step S12), the transmitting microphone 18 is activated to acquire the ambient sound, and the ambient sound for searching the restriction condition table CC based on the ambient sound information is obtained. Check processing is performed (step S16). In this case, the “ambient sound” is accessed for the restriction type, and it is checked whether or not the measured ambient sound meets any restriction condition. As a result, when the restriction condition is satisfied corresponding to one of the “ambient sounds” (YES in step S17), the corresponding restriction type is temporarily stored (step S18) and the “restriction flag” is set as in the case described above. "Is set (step S7), and an incoming call notification with a restricted message is instructed (step S8). On the other hand, when all of the conditions of “place”, “background”, “brightness”, and “ambient sound” are not met and the condition is not satisfied (NO in step S17), an incoming call notification with no restriction message is instructed. (Step S19).

  After the incoming call notification is started in this manner, an off-hook operation (call start operation) is performed (step S20), or an instruction operation (regulation setting operation) for instructing execution of a setting process for setting an arbitrary restriction condition is performed. It is checked whether it has been performed (step S21) or whether the line has been disconnected (step S22). Now, when the line is disconnected, it returns to the initial standby state (step S1), but when a restriction setting operation is performed (YES in step S21), a “restriction flag” is set (step S23). ) After setting a “setting flag” indicating that the setting of transmission restriction conditions has been instructed (step S24), the restriction type menu is displayed and output (step S25). FIG. 10 is a diagram showing a regulation type menu screen. In this menu screen, items “1. Change background”, “2. Pre-registration”, “3. No image”, “4. No sound” are displayed. And when an arbitrary restriction type is selected as a setting target by a user operation (step S26), the restriction type is temporarily stored in the work area of the memory 14 (step S27).

  When an off-hook operation is performed (YES in step S20), the flow proceeds to the flow of FIG. 7, the in-camera 22 is activated (step S28), and the presence / absence of the “restriction flag” is checked (step S29). If the “flag” is not set, videophone communication is started, and the photographed image and sound are transmitted and received mutually (step S45). That is, the captured image captured by the in-camera 22 and the input voice input from the transmission microphone 18 are transmitted to the other party, and the captured image and voice transmitted from the other party are received and output. Let Then, until an on-hook operation (line disconnection operation) is performed (YES in step S46), the photographed image and the voice are transmitted and received to each other (step S45), but when the on-hook operation is performed, the initial standby state is restored ( Step S1) in FIG.

  On the other hand, when the “restriction flag” is set (YES in step S29), the restriction type temporarily stored in the work area of the memory 14 is read, and “background change”, “pre-registration”, “no image” "Or" no sound "is checked (steps S31 to S33). If the restriction type is “background change” (YES in step S31), the photographed image is analyzed to identify the person portion and the contour is extracted (step S34). The “registered image” associated with “change” is read out, and the registered image and the person image portion are synthesized so that the registered image becomes the background (step S35). Then, the synthesized image and the input voice are transmitted to the other party, and the photographed image and the voice transmitted from the other party are received and output (step S36). Thereafter, until the on-hook operation is performed (YES in step S37), the process returns to the above-described step S34, and the above-described operation is repeated (steps S34 to S37).

  If the restriction type is “pre-registration” (YES in step S32), “registration image” associated with “pre-registration” is read from the restriction type table CK (step S38), and this registration image is read. As an alternative to the photographed image, it is transmitted to the other party together with the input voice, and the photographed image and the voice transmitted from the other party are received and output (step S39). Thereafter, the above-described operation is repeated until an on-hook operation is performed (YES in step S40) (step S39).

  If the restriction type is “no image” (YES in step S33), the transmission of the photographed image is canceled, only the input voice is transmitted to the partner, and the photographed image transmitted from the partner is also received. Are received and output (step S41). Hereinafter, the above-described operation is repeated (step S41) until an on-hook operation is performed (YES in step S42). If the restriction type is “no sound” (NO in step S33), the transmission of the input sound is canceled, only the photographed image is transmitted to the partner, and the photographed image transmitted from the partner is also received. Are received and output (step S43). Thereafter, the above-described operation is repeated until an on-hook operation is performed (YES in step S44) (step S43).

  Here, if an on-hook operation is performed, the flow proceeds to the flow of FIG. 8 to check whether or not the “setting flag” is set (step S47). If the “setting flag” is not set, the standby state is set at this time. Returning (step S1 in FIG. 6), if the “setting flag” is set (YES in step S47), a restriction condition selection menu is displayed and output (step S48). FIG. 11 is a diagram showing the restriction condition selection menu screen, in which “current location”, “current background”, “current brightness”, and “current ambient sound” are displayed as restriction conditions. When an arbitrary condition item is selected from the menu screen by a user operation (step S49), the transmission microphone 18, the in-camera 22, the GPS receiver 25, and the illuminance sensor 26 are selectively selected according to the selected condition. To drive.

  That is, when the selection condition is “current location” (YES in step S50), the GPS receiving unit 25 is driven to acquire the current position as condition data (step S51). (YES in step S52), the in-camera 22 is driven to acquire the captured image as condition data (step S53). In the case of “current brightness” (YES in step S54), the illuminance sensor 26 is driven to acquire the measured value (brightness) as condition data (step S55), and “current ambient sound”. In this case (NO in step S54), the transmission microphone 18 is driven and the surrounding sound volume is acquired as the condition data (step S). Then, the restriction condition table CC is accessed based on the “restriction type” selected in the above-described step S26 and the “restriction condition” currently selected in the above-described step S49, and the “restriction type” and the “restriction condition”. The condition data acquired this time is set in the corresponding part (cell part) (step S57). Then, after resetting the “regulation flag” and “setting flag” (step S58), the process returns to the standby state (step S1 in FIG. 6).

  On the other hand, when a telephone call operation is performed (YES in step S60 in FIG. 9), “name” is read from the address book AD and displayed as a list, and an arbitrary “name” is selected from the list, When the other party is selected (step S62), a restriction condition check is performed (step S63). That is, this restriction condition check process is the same as that for the above-described incoming call, that is, a place check (step S4 in FIG. 6), a camera background check (step S10 in FIG. 6), and a brightness check (in FIG. 6). Step S13) Ambient sound check (step S16 in FIG. 6) is performed. If none of the conditions are met and the condition is not satisfied (NO in step S64), videophone communication is started and the photographed image is taken. The operation of transmitting and receiving voices to and from each other is repeated until an on-hook operation is performed (steps S67 and S68).

  If it is determined that the condition is satisfied under any of the conditions (YES in step S64), the videophone communication is restricted by the restriction type corresponding to the condition (step S65). That is, when the restriction type is “background change”, the same processing as steps S34 to S37 in FIG. 7 described above is executed, and a composite image in which the background portion of the photographed image is changed to a registered image is generated and the input voice is generated. When the restriction type is “pre-registration”, the same processing as in steps S38 to S40 described above is executed, and the registered image is transmitted to the other party together with the input voice as an alternative to the photographed image. To do. When the restriction type is “no image”, the same processing as in steps S41 and S42 described above is executed, and only the input voice is transmitted to the other party, and when the restriction type is “no sound”. Performs the same processing as in steps S43 and S44 described above, and transmits only the captured image to the other party. Until the on-hook operation is performed (YES in step S66), the above-described operation is repeated (step S65).

  As described above, in this embodiment, the CPU 11 determines whether or not the environment is inappropriate for the videophone by acquiring the current environmental status during the videophone communication and comparing it with the regulation conditions in the regulation condition table CC. However, if the environment is inappropriate, it is possible to maintain privacy protection, security management, etc. without performing special operations by controlling transmission to the communication partner, and promptly receive unexpected calls. It becomes possible to cope with it, and it is highly practical.

  The CPU 11 obtains the current position information from the GPS receiver 25 during TV phone communication, refers to the restriction condition table CC based on the current position, and determines whether the TV is based on whether the restriction condition of the “location” is met. By determining whether or not the environment is inappropriate for the telephone, the current location can be specified only by acquiring and registering location information such as the home.

  Further, the CPU 11 acquires a background portion from the current photographed image taken at the time of videophone communication, refers to the restriction condition table CC based on the background portion, and characteristically matches the restriction condition of “registered background”. Whether or not the environment is unsuitable for a TV phone based on whether or not it is, it is possible to shoot an arbitrary place and register it as a background image. You can specify where you are.

  The current brightness information is acquired from the illuminance sensor 26 during the TV phone communication, the restriction condition table CC is referred to based on the brightness information, and the TV telephone is determined based on whether or not the “brightness” restriction condition is met. By determining whether or not the environment is inappropriate, it is possible to specify the current location based on the brightness only by registering the brightness of the room or the like.

  The current ambient sound is acquired from the microphone 18 during videophone communication, the restriction condition table CC is referred to based on the ambient sound, and the videophone is called based on whether the restriction condition of “ambient sound” is met. By determining whether or not the environment is inappropriate, it is possible to specify the current location by using the noise as a clue only by registering the noise situation of the room.

  If the CPU 11 obtains the current environmental situation during videophone communication and compares it with the regulation conditions in the regulation condition table CC, if the environment is inappropriate for the videophone, the CPU 11 can replace the background portion of the captured image with a registered image, By replacing the captured image with a registered image, the captured image can be easily changed, which is effective in terms of privacy protection and security management.

  In addition, if the current environmental situation is acquired during videophone communication and compared with the regulation conditions in the regulation condition table CC, if the environment is inappropriate for the videophone, the transmission of the captured image is canceled and only the voice is transmitted. Alternatively, by canceling the transmission of audio and transmitting only the captured image, privacy protection and security management can be ensured.

  The CPU 11 determines whether or not the other party is the other party whose “permission flag” is set in the address book AD, that is, whether or not the other party is a pre-registered registered party. If it is other than the above, the transmission of the TV phone is restricted, but if it is a permitted partner, by releasing the restriction, for example, family, best friend, etc. can be excluded from the restriction.

  The restriction condition table CC includes a plurality of environmental conditions “location”, “background”, “brightness”, “ambient” for each of the plurality of restriction types “background change”, “pre-registration”, “no image”, “no sound”. The CPU 11 stores and manages the restriction conditions for each “sound”, and the CPU 11 compares the restriction conditions for each environment with the current environmental situation as a restriction type, and as a result, the TV 11 determines whether any of the conditions is met. By determining whether or not the environment is inappropriate for the telephone, it is possible to specify the current location based on various environments.

  When the user is instructed to change the regulation condition, the CPU 11 sets the current environmental situation acquired from any of the transmission microphone 18, the in-camera 22, the GPS receiver 25, and the illuminance sensor 26 as the regulation condition. The contents of the regulation condition table CC can be freely changed at any time.

  In the embodiment described above, “place”, “background”, “brightness”, and “ambient sound” are set in one restriction condition table CC, but “place”, “background”, “bright” A separate restriction condition table CC may be provided for each of “sa” and “ambient sound”. In addition, when “place”, “background”, “brightness”, and “ambient sound” are set in one restriction condition table CC, it is limited to OR (logical sum) when determining whether or not the condition is satisfied. Instead, the determination may be performed by AND (logical product). For example, if the logical product of “place” and “background” is used, “place” is set as home and “background” is set as one's room. You can easily identify your room. Further, by combining “location” and “brightness”, it is possible to easily identify a laboratory in the company. Furthermore, “brightness” and “ambient sound” may be combined, or “background” and “ambient sound” may be combined.

  In the embodiment described above, when the restriction condition is set and the CPU 11 meets the condition, the CPU 11 determines that the environment is inappropriate for the TV phone and restricts the transmission. Regulation release conditions may be set. In this case, if the restriction cancellation condition is not met, it is determined that the environment is inappropriate for the TV phone and transmission is restricted. However, when the restriction cancellation condition is met, the environment is suitable for the video phone. The transmission restriction may be canceled by making a determination.

  In the embodiment described above, “place”, “background”, “brightness”, and “ambient sound” are set in the restriction condition table CC, but in addition to this, “time zone” is set. Also good. Accordingly, for example, when the user is at home, the substitute image may be transmitted at midnight, early morning, or mealtime.

In the embodiment described above, a composite image in which the background portion of the photographed image is replaced with a registered image is generated and transmitted. However, the background portion of the photographed image is “blurred”, a mosaic is added, and the image is filled. Processing may be performed.
In addition, the present invention is not limited to a mobile phone device with a TV phone function, and can be similarly applied to a mobile terminal device such as a PDA, an electronic camera, an electronic watch, and a music player with a TV phone function. Of course, it is not limited to the portable terminal device, but may be a fixed telephone.

The block diagram which showed the communication network system at the time of applying to a mobile telephone apparatus with a TV telephone function as a TV telephone apparatus. The block diagram which showed the basic component of the mobile telephone apparatus 1 with a video telephone function. The figure for demonstrating the regulation condition table CC. The figure for demonstrating the regulation seed | species table CK. The figure for demonstrating address book AD. The flowchart which showed the whole operation | movement of the mobile telephone apparatus 1 started execution with power activation. The flowchart following FIG. The flowchart following FIG. The flowchart following FIG. The figure which showed the regulation type menu screen. The figure which showed the regulation condition selection menu screen.

Explanation of symbols

1 Mobile phone device 2 Mobile wireless network 3 Internet 4 PC
5 landline telephone 11 CPU
DESCRIPTION OF SYMBOLS 12 Memory | storage part 15 Telephone communication part 18 Transmission microphone 22 In-camera 26 Illuminance sensor 25 GPS receiving part CC Restriction condition table CK Restriction type table AD Address book

Claims (12)

A videophone device that transmits a captured image captured by a camera during telephone communication with a communication partner and an input sound input to a microphone,
Condition storage means for storing and managing an environmental situation as a transmission control condition for controlling transmission to a communication partner;
Acquisition means for acquiring the current environmental status during telephone communication;
A determination means for determining whether or not the environment is inappropriate for a videophone by comparing the current environmental situation obtained by the acquisition means and the control condition;
Control means for controlling at least one of a photographed image and input sound transmitted to a communication partner when it is determined by the determination means that the environment is inappropriate for a videophone;
A videophone device comprising: In a state where position information of a specific location is stored and managed as the transmission control condition in advance, the acquisition unit acquires current position information during telephone communication, and the determination unit determines that the current position information is the transmission control condition. To determine whether the environment is inappropriate for videophone based on whether or not
The videophone apparatus according to claim 1, wherein the videophone apparatus is configured as described above. In a state where a background part in a photographed image photographed with a specific place as a background is stored and managed as the transmission control condition, the acquisition unit obtains a background part from the current photographed image photographed during telephone communication, The determination means determines whether or not the environment is inappropriate for a videophone based on whether or not the background portion acquired from the current photographed image and the transmission control condition are characteristically matched. To
The videophone apparatus according to claim 1, wherein the videophone apparatus is configured as described above. In a state where ambient brightness information is stored and managed in advance as the transmission control condition, the acquisition unit acquires the current brightness information during telephone communication, and the determination unit includes the current brightness information and the transmission. It is determined whether the environment is inappropriate for a videophone by comparing the control conditions.
The videophone apparatus according to claim 1, wherein the videophone apparatus is configured as described above. In a state where ambient sound information is stored and managed in advance as the transmission control condition, the acquisition unit acquires current ambient sound information during telephone communication, and the determination unit includes the current ambient sound information and the transmission control condition. To determine whether the environment is inappropriate for videophones,
The videophone apparatus according to claim 1, wherein the videophone apparatus is configured as described above. When the determination means determines that the environment is inappropriate for a videophone, the control means changes either the photographed image or the input sound.
The videophone apparatus according to claim 1, wherein the videophone apparatus is configured as described above. When changing the captured image, execute any one of an image processing process that identifies the background part and processes the part, and an alternative process that replaces the captured image with a registered image registered in advance.
The videophone apparatus according to claim 6, which is configured as described above. When it is determined by the determination means that the environment is inappropriate for a videophone, the control means prohibits transmission of either a photographed image or input sound;
The videophone apparatus according to claim 1, wherein the videophone apparatus is configured as described above. Providing a discrimination means for discriminating whether or not the other party is a pre-registered counterpart during telephone communication,
The control unit controls at least one of the photographed image and the input sound according to the determination result by the determination unit.
The videophone apparatus according to claim 1, wherein the videophone apparatus is configured as described above. The condition storage means stores and manages a transmission control condition for each control type in association with a plurality of control types indicating how to control a captured image or input sound,
The determination means is inappropriate for a videophone based on whether or not one of the conditions is met as a result of comparing the current environmental situation obtained by the acquisition means with the transmission control condition for each control type. Determine whether it is an environment,
The videophone apparatus according to claim 1, wherein the videophone apparatus is configured as described above. When a change in the transmission control condition is instructed by a user, the current environmental situation obtained by the acquisition unit is set as the transmission control condition.
The videophone apparatus according to claim 1, wherein the videophone apparatus is configured as described above. Against the computer,
A function for storing and managing the environmental situation as a transmission control condition for controlling the transmission when transmitting a captured image captured by a camera at the time of telephone communication with a communication partner and an input sound input by a microphone;
A function to obtain the current environmental status during telephone communication,
A function of determining whether or not the environment is inappropriate for a videophone by comparing the acquired current environmental situation and the transmission control condition;
A function for controlling at least one of a captured image and input sound transmitted to a communication partner when it is determined that the environment is inappropriate for a videophone;
A program to realize

Images