KR20100023324A - Apparatus and method for controlling vibration of mobile terminal - Google Patents

Abstract

The mobile terminal according to the present invention adds directionality to vibration by using at least one or more vibration elements, so that the user can feel the tension or mobility of the video (or game) screen as it is. In addition, the present invention can provide the user with synesthesia by visual, auditory, and tactile effects by stimulating the tactile sense by vibrating directional.

The mobile terminal according to the present invention detects motion information of a specific object in the content consisting of at least one of audio and video, and detects motion information of a specific object in the content and controls a vibration module including at least one vibration element according to the detected information. It is configured to include a control unit.

Description

Vibration control device and method of mobile terminal {APPARATUS AND METHOD FOR CONTROLLING VIBRATION OF MOBILE TERMINAL}

The present invention relates to a mobile terminal, and more particularly to a vibration control of the mobile terminal.

A mobile terminal is a portable device that is portable and has one or more functions such as voice and video calling, information input and output, and data storage.

As the mobile terminal has various functions other than communication, for example, it has complex functions such as taking a picture or a video, playing a music or video file, playing a game, and receiving a broadcast. ) Is implemented.

Various attempts are being made on these multimedia devices in terms of hardware or software to implement complex functions.

Recently, terminal manufacturers are interested in the development of a mobile terminal to which a touch screen is applied so that a user can operate and select a menu easily and conveniently. As the user's attention is focused on the touch screen application terminal, a lot of investment is being made in the development and research on the user interface (UI) or vibration feedback driven on the touch screen.

An object of the present invention is to provide a mobile terminal having a directional vibration effect.

The mobile terminal according to the present invention adds directionality to vibration by using at least one or more vibration elements, so that the user can feel the tension or mobility of the video (or game) screen as it is.

In addition, the present invention can provide the user with synesthesia by visual, auditory, and tactile effects by stimulating the tactile sense by vibrating directional.

In order to achieve the above object, the mobile terminal according to the present invention

A signal processing unit for reproducing content composed of at least one of audio and video, a vibration module including at least one vibration device, and a control unit for detecting motion information of a specific object in the content and controlling the vibration device according to the detected information. It is configured to include.

In order to achieve the above object, the vibration control method of the mobile terminal according to the present invention

Playing content comprising at least one of audio and video; detecting motion information of a specific object in the content being played; and controlling vibration according to the detected information.

Hereinafter, the configuration of a preferred mobile terminal of the present invention with reference to the drawings as follows. The suffixes "module" and "unit" for components used in the following description are merely given in consideration of ease of preparation of the present specification, and do not impart any particular meaning or role by themselves. Therefore, it should be noted that the "module" and "unit" may be used interchangeably with each other.

1 is a block diagram of a mobile terminal of the present invention.

The mobile terminal can be implemented in various forms. For example, a mobile terminal described in the present specification may be a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, or the like. There are terminals and fixed terminals such as digital TVs, desktop computers and the like. In the following description, it is assumed that the terminal is a mobile terminal. However, it will be readily apparent to those skilled in the art that the configuration according to the following description may also be applied to the fixed terminal except for components specially configured for mobile use.

Referring to Figure 1, looking at the mobile terminal of the present invention from a functional point of view as follows.

The mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory unit 160, and an interface unit. It may include components such as the 170, the controller 180 and the power supply 190.

1 illustrates a mobile terminal having various components. However, not all illustrated components are essential components. The mobile terminal may be implemented by more components than the illustrated components, or the mobile terminal may be implemented by fewer components.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more components for wireless communication between the mobile terminal 100 and a wireless communication system or wireless communication between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may select at least one of the broadcast receiving module 111, the mobile communication module 112, the wireless internet module 113, the short range communication module 114, and the location information module 115. It may include.

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives a broadcast signal using various broadcast systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals may be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcast systems providing broadcast signals as well as the digital broadcast system described above. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

In addition, the mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text / multimedia message.

The wireless internet module 113 is for wireless internet access and may be embedded or external to the portable terminal. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

In addition, the location information module 115 is a module for checking or obtaining the location of the mobile terminal. One example is the Global Position System (GPS) module. The GPS module receives location information from a plurality of satellites. Here, the location information may include coordinate information represented by latitude and longitude. For example, the GPS module can measure the exact time and distance from three or more satellites and accurately calculate the current position by triangulating three different distances. A method of obtaining distance and time information from three satellites and correcting the error with one satellite may be used. In particular, the GPS module can obtain not only the location of latitude, longitude, and altitude but also accurate time together with three-dimensional speed information from the location information received from the satellite.

The A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame of a still image or a moving image obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to a configuration aspect of the terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. In the case of the call mode, the processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may have various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (constant voltage / capacitance), a jog wheel, a jog switch, and the like. In particular, when the touch pad forms a mutual layer structure with the display unit 151 to be described later, this may be referred to as a touch screen.

The sensing unit 140 determines the current state of the mobile terminal 100 such as the open / closed state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, the acceleration / deceleration of the mobile terminal, and the like. Sensing and generating a sensing signal for controlling the operation of the mobile terminal 100. For example, if the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it is responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like. The sensing unit 140 may include a proximity sensor 141. This will be described later with reference to the touch screen.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, The video input / output (I / O) port, the earphone port, and the like may be included in the interface unit 170.

Here, the identification module is a chip that stores a variety of information for authenticating the use authority of the mobile terminal 100, a user identification module (UIM), Subscriber Identify Module (SIM) '), A Universal Subscriber Identity Module ("USIM"), and the like. In addition, the device equipped with the identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Therefore, the identification device may be connected to the terminal 100 through a port.

The interface unit 170 receives data from an external device or receives power and transmits the data to each component inside the mobile terminal 100 or transfers the data of the mobile terminal 100 to the external device.

In addition, when the mobile terminal 100 is connected to an external cradle, the interface unit 170 serves as a passage through which power from the cradle is supplied to the mobile terminal 100 or inputted from the cradle by a user. Various command signals may be a passage for transmitting to the mobile terminal. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, the mobile terminal displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays a photographed and / or received image, a UI, or a GUI.

As described above, when the display unit 13 and the touch pad form a mutual layer structure to form a touch screen, the display unit 151 may be used as an input device in addition to the output device. The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, or a three-dimensional display. 3D display). Some of these displays can be configured to be transparent so that they can be seen from the outside. This may be referred to as a transparent display. A representative example of the transparent display is a transparent organic light emitting diode (TOLED). In addition, two or more display units 151 may exist according to the implementation form of the mobile terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile terminal 100.

The touch screen may be configured to detect a touch input pressure as well as a touch input position and area.

The proximity sensor 141 may be disposed inside or near the touch screen. The proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using a mechanical contact by using an electromagnetic force or infrared rays. Therefore, the proximity sensor 141 has a considerably longer life than the contact sensor, and its utilization is also considerably higher.

Examples of the proximity sensor 141 include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

To explain an example of the operation principle of the high frequency oscillation type proximity sensor, the oscillation amplitude of the oscillation circuit is attenuated or stopped when the sensing object approaches the sensor sensing surface in the state of oscillating the high frequency wave of the wave in the oscillation circuit. This change is converted into an electrical signal to detect the presence or absence of a sensing object. Therefore, even if a non-metallic material comes between the high frequency oscillation proximity sensor and the sensing object, the proximity switch can detect the sensing object to be detected without interference of the object.

Even if the proximity sensor 141 is not firmly mounted, when the touch screen is capacitive, the proximity sensor 141 may be configured to detect the proximity of the pointer by a change in an electric field according to the proximity of the pointer.

Therefore, when the pointer is located in close proximity to the touch screen although it is not actually touched, the position of the pointer and the distance between the pointer and the touch screen may be detected. Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized on the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the pointer on the touch screen is referred to as "proximity touch". The act of actually contacting will be referred to as "contact touch". In addition, the position of the proximity touch with the pointer on the touch screen refers to a position where the pointer is perpendicular to the touch screen when the pointer is in proximity touch.

The proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, and proximity touch movement state). According to the detected proximity touch operation and the proximity touch pattern, corresponding information may be output on the touch screen.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed by the mobile terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of the event include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 outputs a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. When a call signal is received or a message is received, the alarm unit 153 may output a vibration to inform this. Alternatively, when a key signal is input, vibration may be output as feedback to the key signal input. The user can recognize the occurrence of the event through the vibration output as described above. Of course, a signal for notification of event occurrence may be output through the display unit 151 or the sound output module 152.

The memory 160 may store a program for processing and controlling the controller 180, and a function for temporarily storing input / output data (for example, a phone book, a message, a still image, a video, etc.). You can also do In addition, the memory 160 may store data on vibration and sound of various patterns output when a touch input on the touch screen is performed.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) magnetic memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. In addition, the mobile terminal 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The controller 180 typically controls the overall operation of the mobile terminal. Perform related control and processing for voice calls, data communications, video calls, etc. In addition, the controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The various embodiments described herein may be implemented in a computer readable recording medium using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing the functions. It may be implemented by the controller 180.

In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. In addition, the software code may be stored in the memory 160 and executed by the controller 180.

In the above, the internal components of the mobile terminal related to the present invention have been described from a functional point of view. Next, with reference to Figures 2 and 3, we will look at the external components of the mobile terminal related to the present invention from a functional point of view. Hereinafter, for simplicity, a slider type mobile terminal is described as an example among various types of mobile terminals such as a folder type, a bar type, a swing type, a slider type, and the like. This does not mean that the present invention is limited to the slider type mobile terminal, and may be applied to all types of mobile terminals including the above-described type.

2 is a front perspective view of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 of the present invention includes a first body 200 and a second body 205 configured to be slidable in at least one direction on the first body 200. In the case of a folder phone, the mobile terminal 100 will include a first body and a second body configured to be folded or unfolded on at least one side of the first body. (Different from English)

A state in which the first body 200 is disposed to overlap with the second body 205 may be referred to as a closed configuration, and as shown in the drawing, the first body 200 may be referred to as the second body 205. The exposed state of at least a portion of the N may be referred to as an open configuration.

Meanwhile, although not shown in the drawings, the mobile terminal related to the present invention may be a folder type including a first body and a second body configured to be folded or unfolded on at least one side of the first body. Here, a state in which the second body is folded may be referred to as a closed state, and a state in which the second body is configured to be unfolded may be referred to as an open state.

Furthermore, the mobile terminal associated with the present invention may be a swing type including a first body and a second body configured to swing relative to the first body, although not shown in the drawings. Here, a state in which the first body is disposed to overlap the second body may be referred to as a closed state, and a state in which a portion of the first body is exposed by swinging the second body may be referred to as an open state.

The terminal according to the folder type and the swing type is considered to be easily understood by those skilled in the art even if there is no separate description, so a detailed description thereof will be omitted.

The mobile terminal mainly operates in a standby mode in a closed state, but the standby mode may be released by a user's operation. In addition, although the mobile terminal operates mainly in a call mode or the like in an open state, the mobile terminal may be switched to a standby mode by a user's manipulation or a lapse of a predetermined time.

The case (casing, housing, cover, etc.) forming the exterior of the first body 200 is formed by the first front case 220 and the first rear case 225. Various electronic components are embedded in the space formed by the first front case 220 and the first rear case 225. At least one intermediate case may be further disposed between the first front case 220 and the first rear case 225.

The cases may be formed by injecting a synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the audio output module 152, the camera 121, or the first user input unit 210 may be disposed in the first body 200, specifically, the first front case 220.

The display unit 151 includes a liquid crystal display (LCD), organic light emitting diodes (OLED), and the like, which visually express information.

In addition, since the touch pad is superimposed on the display unit 151 in a layer structure, the display unit 151 may operate as a touch screen to enable input of information by a user's touch.

The sound output module 152 may be implemented in the form of a speaker.

The camera 121 may be implemented to be suitable for capturing an image or a video of a user or the like.

Like the first body 200, the case forming the exterior of the second body 205 is formed by the second front case 230 and the second rear case 235.

The second user input unit 215 may be disposed on the second body 205, specifically, on the front face of the second front case 230.

The third user input unit 245, the microphone 122, and the interface unit 170 may be disposed on at least one of the second front case 230 or the second rear case 235.

The first to third user inputs 210, 215, and 245 may be collectively referred to as a manipulating portion 130, and may be any method as long as the user is tactile in a tactile manner. Can be employed.

For example, the user input unit may be implemented as a dome switch or a touch pad capable of receiving a command or information by a user's push or touch operation, or a wheel or jog method of rotating a key, or a manipulation method such as a joystick. May also be implemented.

In the functional aspect, the first user input unit 210 is for inputting a command such as start, end, scroll, etc., and the second user input unit 215 is for inputting numbers, letters, symbols, and the like. The first user input unit 210 includes a so-called soft key used in conjunction with icons displayed on the display module 151 and a navigation key (mainly composed of four direction keys and a center key) for direction indication and confirmation. can do.

The third user input unit 245 may operate as a hot key for activating a special function in the mobile terminal.

The microphone 122 may be implemented in a form suitable for receiving a user's voice, other sounds, and the like.

The interface unit 170 serves as a passage for allowing the mobile terminal according to the present invention to exchange data with an external device. For example, the interface unit 170 is wired or wirelessly, a connection terminal for connecting with an earphone, a port for short-range communication (for example, an infrared port (IrDA port), a Bluetooth port, a wireless LAN) Port (wireless Lan port, etc.), or at least one of power supply terminals for supplying power to the mobile terminal.

The interface unit 170 may be a card socket that accommodates an external card such as a subscriber identification module (SIM) or a user identity module (UIM) and a memory card for storing information.

The power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the second rear case 235 side.

The power supply unit 190 may be detachably coupled for charging, for example, as a rechargeable battery.

Figure 3 is a rear perspective view of a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 3, a camera 121 may be additionally mounted on the rear surface of the second rear case 235 of the second body 205. The camera 121 of the second body 205 has a photographing direction substantially opposite to that of the camera 121 of the first body 200, and different pixels from the camera 121 of the first body 200. Can have

For example, the camera 121 of the first body 200 has a low pixel (low resolution) so that the user's face is photographed and transmitted to the counterpart in case of a video call or the like, and the camera 121 of the second body 121 In general, it is preferable to have a high pixel (high resolution) because a normal subject is often photographed and not immediately transmitted.

The flash 250 and the mirror 255 may be further disposed adjacent to the camera 121 of the second body 205. The flash 250 illuminates the subject when the subject is photographed by the camera 121 of the second body 205. The mirror 255 allows the user to see the user's face or the like when the user wants to photograph himself (self-photographing) using the camera 121 of the second body 205.

The sound output module 152 may be further disposed on the second rear case 235.

The sound output module 152 of the second body 205 may implement a stereo function together with the sound output module 152 of the first body 200, and may be used for a call in a speakerphone mode.

In addition, an antenna 260 for receiving a broadcast signal may be disposed on one side of the second rear case 235. The antenna 260 may be installed to be pulled out of the second body 205.

A portion of the slide module 265 that slidably couples the first body 200 and the second body 205 is disposed at the side of the first rear case 225 of the first body 200.

The other part of the slide module 265 may be disposed on the second front case 230 side of the second body 205 and may not be exposed to the outside as shown in the drawing.

In the above description, the second camera 121 and the like have been described as being disposed in the second body 205, but the present invention is not limited thereto.

For example, at least one or more of the components 260, 121 to 250, and 152 described as disposed on the second rear case 235, such as the camera 121 of the second body, may be the first body 200. May be mounted on the first rear case 225. In such a case, there is an advantage that the configuration (s) disposed in the first rear case 225 in the closed state are protected by the second body 205. Furthermore, even if the camera 121 of the second body is not provided separately, the camera 121 of the first body may be rotatably formed so that the camera 121 of the second body may be photographed up to the photographing direction of the camera 121 of the second body. .

The terminal 100 illustrated in FIGS. 1 to 3 may operate in a communication system capable of transmitting data through a frame or packet, including a wired / wireless communication system and a satellite-based communication system. It can be configured to.

Next, a communication system capable of operating a terminal according to the present invention will be described with reference to FIG.

The communication system may use different air interfaces and / or physical layers. For example, a radio interface usable by a communication system may include frequency division multiple access (FDMA), time division multiple access (TDMA), and code division multiple access (Code Division). Multiple Access ('CDMA'), Universal Mobile Telecommunica-tions Systems ('UMTS') (especially Long Term Evolution (LTE)), Global System for Mobile Communications ('GSM') Etc. may be included. Hereinafter, for convenience of description, the description will be limited to CDMA. However, it is a matter of course that the present invention is applicable to all communication systems including the CDMA wireless communication system.

As shown in FIG. 4, the CDMA wireless communication system includes a plurality of terminals 100, a plurality of base stations (BS) 270, and base station controllers (BSCs) 275. ), And a mobile switching center (MSC) 280. The MSC 280 is configured to be connected to a public switched telephone network (PSTN) 290 and is also configured to be connected to BSCs 275. The BSCs 275 may be coupled to the BS 270 through a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. Thus, a plurality of BSCs 275 may be included in the system shown in FIG.

Each BS 270 may include at least one sector, and each sector may include an omnidirectional antenna or an antenna pointing radially out of BS 270. In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments, each of which has a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of sectors and frequency assignments may be called a CDMA channel. BS 270 may be referred to as a base station transceiver subsystem ('BTSs'). In this case, the word "base station" may be called the sum of one BSC 275 and at least one BS 270. The base station may also indicate “cell site”. Alternatively, each of the plurality of sectors for a particular BS 270 may be called a plurality of cell sites.

As shown in FIG. 4, a broadcasting transmitter (BT) 295 transmits a broadcast signal to terminals 100 operating in the system. The broadcast receiving module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295.

In addition, FIG. 4 illustrates several satellite positioning systems (GPS) satellites 300. The satellites 300 help to locate the at least one terminal of the plurality of terminals 100. Although two satellites are shown in FIG. 4, useful location information may be obtained by two or less or more satellites. The location information module 115 shown in FIG. 1 cooperates with the satellites 300 to obtain desired location information. Here, the location can be tracked using all the techniques that can track the location, not just the GPS tracking technology. In addition, at least one of the GPS satellites 300 may optionally or additionally be responsible for satellite DMB transmission.

During typical operation of a wireless communication system, BS 270 receives reverse link signals from various terminals 100. At this time, the terminals 100 are connecting a call, transmitting or receiving a message, or performing another communication operation. Each of the reverse link signals received by a particular base station 270 is processed within by the particular base station 270. The data generated as a result of the processing is transmitted to the connected BSC 275. BSC 275 provides call resource allocation and mobility management functionality, including the organization of soft handoffs between base stations 270. In addition, the BSC 275 transmits the received data to the MSC 280, and the MSC 280 provides an additional transmission service for connection with the PSTN 290. Similarly, PSTN 290 connects with MSC 280, MSC 280 connects with BSCs 275, and BSCs 275 send BSs 270 to transmit a forward link signal to terminals 100. ).

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. An object of the present invention is to implement a mobile terminal that adds directionality to vibration.

A first embodiment of the present invention relates to a method of applying vibration to video playback.

5 is a flowchart showing vibration control according to the first embodiment of the present invention, and FIG. 6 is an exemplary view of the vibration control UI according to the first embodiment.

According to the present invention, as shown in a) of FIG. 6, prior to playing a video, the user first decides whether to activate the vibration mode (set or release). And when the vibration mode is activated, set the mode type of vibration. (S10 & S20) For example, one of various modes such as an action mode, a sports mode, a drama mode, a concert mode, a game mode, and an FX mode is selected.

Thereafter, when a codec is executed to play a video and a specific video is selected according to a user input, the controller 180 first checks a compression type of the selected video. (S30 & S40) And, the video If it is determined that the MPEG-2 method is used, the controller 180 extracts a motion vector from, for example, B-frame (or P-frame) of the video from the specific video data of the video. The vibration direction and the intensity of the vibration elements are controlled according to the extracted motion vector. (S60) It is assumed that the vibration unit according to the present embodiment includes four vibration elements.

MPEG-2 is an extension of MPEG-1. Unlike MPEG-1, which is suitable for playing on a CD-ROM, MPEG-2 is suitable for applications stored in high definition and TV broadcasting applications. In the case of satellite broadcasting, MPEG-2 can encode five or more digital channels without loss of picture quality in the same bandwidth as one analog channel currently uses.

6B is a diagram illustrating vibration control of a video using audio data.

As shown in b) of FIG. 6, the terminal according to the present invention may control vibration of the terminal by using PAM () data. The controller 180 detects palm (PAM) data of stereo audio from the moving image of the codec, and determines the direction and intensity of vibration according to the detected palm (PAM) data.

When the user sets stereo vibration, the controller 180 drives at least one vibration device (eg, two or more) to control vibration of the devices according to the detected PAM data. do. When the user sets surround vibration, the controller 180 drives at least two vibration elements (for example, three or more) to generate vibration of the elements according to the detected PAM data. To control.

Vibration control using audio data and vibration control using video data may be selectively applied to the terminal, or may be applied repeatedly.

On the other hand, MPEG-4, unlike MPEG-1 used in video and CD, and MPEG-2 used in broadcasting and HDTV, has been standardized with the goal of expanding its use to low bit rate situations. As an encoding technique, it is based on H.263, which has been standardized first, and added several tools. The differences from H.263 include the use of B frames in inter-frame prediction and the introduction of AC / DC prediction of DCT coefficients. In the MPEG-4 method, various objects constituting a scene (or image) are separately compressed and transmitted, and the compressed information is transmitted.

7 is a diagram illustrating a vibration setting screen of a video based on the MPEG-4 method.

When playing a video according to MPEG-4 (or H.264), the present invention can select an object to which vibration is applied, as shown in FIG. (S70)

If it is determined in step S40 that the video selected is according to the MPEG-4 method (or H.264 method), the user may select one of the objects appearing in the video, as shown in FIG. Display the UI screen as shown.

When a specific object is selected on the UI screen, the controller 180 controls the vibration direction and the intensity of the vibration elements according to the movement (eg, a motion vector) of the selected object. (S80)

8 is an exemplary diagram of a vibration control UI according to a second embodiment of the present invention, in which vibration control according to the present invention is applied to a game.

When the vibration control according to the present invention is applied to a game, the controller 180 controls the vibration elements similar to the MPEG-4 method (or the H.264 method). As shown in FIG. 8, the characters of the game are listed, and the user sets a character to which the vibration is applied. Then set the intensity of vibration and the mode type of vibration (eg action mode, sport mode, drama mode, concert mode, combat scene mode, etc.).

In the UI of FIG. 8, when a character to which vibration is applied is set, the controller 180 controls the vibration direction and the intensity of the vibration elements according to the movement (eg, a motion vector) of the selected character.

9 is a flowchart showing vibration control according to the third embodiment of the present invention, and FIG. 10 is an exemplary view of vibration control according to the third embodiment.

As shown in FIG. 9, when a predetermined image viewer is executed, the controller 180 first sets a threshold (hereinafter, referred to as a threshold point 610) for image movement. In this case, 'setting' the threshold 610 does not impart a specific value, but means that the threshold 610 is activated (activated) in moving the image. 10 illustrates a threshold point on a screen for convenience of explanation.

In FIG. 10, the user views images (image # 1, image # 2, image # 3, image # 4,..., Image # n) of the viewer screen 600, and the finished image is viewed. The next step is moved to the next point 620 for viewing the image. The user moves an image (eg, image # 2) through a predetermined touch operation (eg, touch and drag (Flick + Drag) or flicking).

The controller 180 detects this when the image movement is started by a user's touch manipulation (for example, touch and drag or flicking) and outputs a vibration. (S220)

The threshold 610 is a reference point for moving the image.

Depending on whether the moving image by the user's touch manipulation has crossed the threshold 610, the image is returned to its original position or moved to the target point 620. That is, when the user takes a touch operation without moving the image completely, when the taken-in point exceeds the threshold 610, the image (image # 2) moves to the target point 620. . However, when the threshold point 610 is not exceeded, the image # 2 does not move to the target point 620. Image # 2 returns to its original position.

According to the present invention, an acceleration movement technique (acceleration mechanism) can be applied to the movement of an image returning to its original position and the movement of the image moving to the target point 620 after the user takes a touch operation. . The acceleration motion technique is an animation technique in which a physical motion law of acceleration and reverse acceleration is applied so that the movement of a selected object on the UI has a real-life feeling when implementing a graphical user interface (GUI).

In step S220, the controller 180 outputs a vibration from the moment when the movement of the image # 2 is detected, and gradually increases the intensity of the vibration as the closer to the threshold 610. (S230 & S240). The moment of passing the critical point 610 is output the vibration of the strongest intensity, and from the moment passing through the critical point 610 the intensity gradually decreases. According to the present invention, the intensity of vibration is proportional to the distance between the image and the critical point 610. When the image is moved in the opposite direction of the critical point 610 from the original location, the vibration is proportional to the moving distance. The intensity of the output is also weak. (S230 & S250)

Since the intensity of vibration is gradually weakened from the moment passing through the critical point 610, the user according to the present invention can grasp the critical point 610 only by the intensity of the vibration transmitted through the touch, and at any point only by the touch. You can see if you can reap the When the user touches a point past the threshold 610, the image automatically moves to the target point 620.

FIG. 11 is an exemplary diagram of vibration control using two vibration elements as another embodiment of FIG.

When a predetermined image viewer is executed, the controller 180 drives two vibrating elements 650 and 660 at two points, as shown in FIG. 11, instead of setting the threshold point 610. .

And, as shown in Figure 10, when the user moves the image # 2 to the side point 620 for viewing the image of the next order, the controller 180 drives the vibration elements (650, 660).

The controller 180 detects the movement of an image by a user's touch manipulation (for example, touch and drag or flicking), and detects the first vibration element 650 and the second. The vibration of the vibrating element 660 is driven at different intensities. By controlling the intensity of the first vibrating element 650 strongly and the strength of the second vibrating element 660 weakly, the user who moves the image will feel a weaker vibration as the target point 620 approaches.

12 is a flowchart showing vibration control according to the fourth embodiment of the present invention, and FIGS. 13 to 15 are illustrations of vibration control according to the fourth embodiment. The mobile terminal according to this embodiment constitutes a vibration element as shown in FIG.

When a predetermined image viewer (eg, a camera album, etc.) is executed in the terminal (S310), the controller 180 first selects a specific image according to a user input (S320) and is selected as shown in FIG. 14. Display an image on the screen and wait for user input.

Subsequently, when an input for instructing image enlargement (or zoom-in) is received from the user, as illustrated in FIG. 14, the controller 180 drives the third vibration device 670. In this case, the controller 180 controls the third vibration device 670 so that the vibration is transmitted radially outward from the center of the screen.

If an input for instructing image reduction is received from the user, as illustrated in FIG. 15, the controller 180 drives the first vibrating element 650 and the second vibrating element 660. (S330 & S350) In this case, vibrations generated by the first and second vibration elements 650 and 660 are transmitted radially from the outside to the center of the screen.

The controller 180 controls driving of the vibrating device so that the user can feel the vibration while the user inputs an image enlargement (or reduction) button (for example, a software key or a hardware button), that is, while the user presses the button. Keep it.

16 is an exemplary view illustrating image enlargement and reduction by multi-touch input.

According to the present embodiment, when the image is enlarged (or reduced) by the multi-touch input, a more realistic feeling may be transmitted to the user. While zooming in or out of an image with multi-touch, the user can detect a change in the intensity of vibration of the screen.

FIG. 17 illustrates a method of changing the intensity of vibration according to the extent to which the image is enlarged (or reduced) according to another embodiment of FIG. 12.

Each time an image enlargement (or zoom-in) button is input, the controller 180 increases the intensity of vibration step by step. In addition, whenever the image reduction (or zoom-out) button is input, the controller 180 decreases the intensity of vibration step by step.

The vibration control according to each embodiment of the present invention can be implemented as computer readable codes on a medium on which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored.

Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and are also implemented in the form of a carrier wave (for example, transmission over the Internet). It includes being. The computer may include the controller 180 of the mobile terminal.

As described above, the mobile terminal according to the present invention adds directionality to the vibration by using at least one or more vibrating elements, so that the user can feel the tension or mobility of the video (or game) screen as it is.

In addition, the present invention can provide the user with synesthesia by visual, auditory, and tactile effects by stimulating the tactile sense by vibrating directional.

Although the present invention has been described with reference to the embodiment (s) shown in the drawings, this is merely exemplary, and various modifications can be made therefrom by those skilled in the art, and the embodiments described above ( It will be appreciated that all or some of these may be optionally combined. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

1 is a block diagram of a mobile terminal according to one embodiment of the present invention;

2 is a front perspective view of a mobile terminal according to an embodiment of the present invention;

3 is a rear perspective view of a mobile terminal according to one embodiment of the present invention;

4 is a block diagram of a wireless communication system in which a mobile terminal according to an embodiment of the present invention may operate.

5 is a flowchart showing vibration control according to the first embodiment of the present invention.

6 is an exemplary view of a vibration control UI according to the first embodiment.

7 is a view showing a vibration setting screen of a video according to the MPEG-4 method.

8 is an exemplary view of a vibration control UI according to a second embodiment of the present invention.

9 is a flowchart showing vibration control according to a third embodiment of the present invention.

10 is an illustration of vibration control according to a third embodiment.

11 is an illustration of vibration control using two vibration elements.

12 is a flowchart showing vibration control according to the fourth embodiment of the present invention.

13 to 15 are illustrations of vibration control according to the fourth embodiment.

16 is an exemplary diagram illustrating image enlargement and reduction by multi-touch input.

FIG. 17 is a diagram illustrating another method of changing the intensity of vibration according to the extent to which an image is enlarged (or reduced);

*** Explanation of symbols for main parts of drawing ***

100: mobile terminal

110: wireless communication unit 120: AV input unit

130: user input unit 140: sensing unit

150: output unit 160: memory

170: interface unit 180: control unit

190: power supply unit

Claims (9)

A signal processor that reproduces content consisting of at least one of audio and video; A vibration module including at least one vibration element; And a control unit for detecting motion information of a specific object in the content and controlling the vibrating device according to the detected information. The method of claim 1, wherein the control unit A mobile terminal, characterized in that for controlling the vibration direction and intensity of the vibration element in accordance with the detected information. The method of claim 1, wherein the control unit And detecting information from palm data of stereo audio and controlling the vibrating element according to the detected information. The method of claim 1, wherein the control unit And detecting information based on an I-frame or a P-frame of a motion vector, and controlling the vibrating element according to the detected information. The method of claim 1, wherein the control unit And detecting a touch input from the outside and controlling the vibrating element according to the detected information. Playing content consisting of at least one of audio and video: Detecting motion information of a specific object in the content being played; Vibration control method of a mobile terminal, characterized in that comprising the step of controlling the vibration in accordance with the detected information. The method of claim 6, wherein the vibration control step Vibration control method of a mobile terminal, characterized in that for controlling the direction and intensity of vibration in accordance with the detected information. The method of claim 6, wherein the detecting of the motion information comprises: Vibration control method of a mobile terminal, characterized in that detected from the palm data (PAM data) of stereo audio. The method of claim 6, wherein the vibration control step Vibration control method of a mobile terminal, characterized in that for controlling the vibration based on the I-frame or P-frame of the motion vector.

Images