CN106897004A

CN106897004A - A kind of method of adjustment of mobile terminal and display interface

Info

Publication number: CN106897004A
Application number: CN201710106361.8A
Authority: CN
Inventors: 杜国威
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2017-02-27
Filing date: 2017-02-27
Publication date: 2017-06-27

Abstract

The invention discloses a kind of mobile terminal and the method for adjustment of display interface.The mobile terminal includes：Detection unit, for when mobile terminal is fixed on virtual reality device and opens the function of adjust automatically display interface, detecting the contact area of display screen and virtual reality device form；Adjustment unit, for adjusting position of the display interface in display screen according to contact area, so that display interface is completely shown in the window of VR equipment.Mobile terminal in the present invention can be with the position in the place display screen of the adjustment display interface of self adaptation, so that virtual reality device can watch the video or image of display in optimal form, so that user there are more preferably immersive effects, the experience of user is improved.

Description

Mobile terminal and display interface adjusting method

Technical Field

The invention relates to the technical field of movement, in particular to a mobile terminal and a display interface adjusting method.

Background

Virtual Reality (VR) is a collection of simulation technology and various technologies such as computer graphics man-machine interface technology, multimedia technology, sensing technology, and network technology, and is a challenging leading-edge subject of cross technology and research field. The virtual reality technology comprises aspects of a simulation environment, perception, natural skills, sensing equipment and the like, wherein the simulation environment is a three-dimensional stereoscopic realistic image which is generated by a computer and is dynamic in real time.

The principle of the head-mounted virtual reality device is to magnify the image generated by the small two-dimensional display by an optical system. Specifically, the image of the display passes through an eccentric free-form surface lens, so that the image becomes similar to a large screen picture. Since the eccentric free-form surface lens is a slant concave lens, it has not only a lens function but also a free-form surface prism. When the generated image enters the eccentric free-form surface prism surface, it is totally reflected to the concave mirror surface on the opposite side of the viewer's eyes. The side concave mirror surface is coated with a mirror coating, and the light is reflected and amplified again to the eccentric free-form surface prism surface at the same time of reflection, and the inclination of the light is corrected on the surface to reach the eyes of a viewer.

At present, VR equipment mainly falls into three main categories: VR helmet, VR all-in-one, VR box. In these three major VR categories, the experience of the VR box is mildest, but it allows the average consumer to walk into the virtual real world at the lowest cost. The structure of the VR box is really simple, namely one box and two convex lenses. Then can constitute a VR experience system through mobile terminal screen display VR content, can understand: VR box + mobile terminal + VR content. In the prior art, after a mobile terminal is placed in a slot or a clamp in VR head-mounted virtual reality equipment, a picture displayed by a display screen of the mobile terminal cannot be adjusted by a user. Especially when the display screen is large, for the user in the VR experience, the whole display screen cannot be acquired. Therefore, the degree of immersion of the user is seriously affected. Obviously, the current technology cannot meet the increasing immersion level requirement of users.

Disclosure of Invention

The invention mainly aims to provide a mobile terminal and a display interface adjusting method, which are used for solving the problem that the mobile terminal in the prior art cannot be matched with a virtual reality device window due to the fact that a display interface is fixed.

In order to achieve the purpose, the invention adopts the following technical scheme:

according to an aspect of the present invention, there is provided a mobile terminal including:

the mobile terminal comprises a detection unit, a display unit and a display unit, wherein the detection unit is used for detecting a contact area between a display screen and a virtual reality equipment window when the mobile terminal is fixed on the virtual reality equipment and starts a function of automatically adjusting a display interface;

and the adjusting unit is used for adjusting the position of the display interface in the display screen according to the contact area so as to enable the display interface to be completely displayed in the window range of the virtual reality equipment.

Further, the display screen is a pressure touch display screen, and the detection unit is specifically configured to:

acquiring coordinates of a coordinate point of which the pressure value in the display screen is greater than a preset threshold value;

and judging whether the coordinates of each coordinate point meet a preset rule or not, and judging that the area where each coordinate point is located is the contact area when the coordinates meet the preset rule.

Further, the adjusting unit includes:

the determining module is used for determining a non-contact area of the display screen within the range of the virtual reality equipment window according to the coordinates of each coordinate point of the contact area;

and the adjusting module is used for adjusting the display interface to the position of the non-contact area.

Further, the determining module is specifically configured to:

acquiring coordinates of coordinate points positioned at four corners of the contact area;

acquiring each coordinate point with a pressure value smaller than a preset threshold value in an area surrounded by the coordinate points at the four corners;

and the region where each coordinate point is located is the non-contact region.

Further, the adjusting module is specifically configured to:

calculating the length and the width of the non-contact area according to the coordinates of the non-contact area;

and adjusting the length and the width of the display interface to the length and the width of the non-contact area respectively.

According to an aspect of the present invention, there is provided a method for adjusting a display interface, used in a mobile terminal, including:

when the mobile terminal is fixed on virtual reality equipment and the function of automatically adjusting a display interface is started, detecting a contact area between a display screen and a virtual reality equipment window;

and determining the position of the display interface in the display screen according to the contact area so that the display interface is completely displayed in the window range of the virtual reality equipment.

Further, the display screen is pressure touch display screen, when detecting the display screen with the contact area of virtual reality equipment window specifically includes:

Further, the determining the position of the display interface in the display screen according to the contact position specifically includes:

determining a non-contact area of the display screen within the range of the virtual reality equipment window according to the coordinates of each coordinate point of the contact area;

and adjusting the display interface to the position of the non-contact area.

Further, the determining a non-contact area of the display screen within the virtual reality device window according to the coordinates of each coordinate point of the contact area includes:

Further, the adjusting the display interface to the position of the non-contact area specifically includes:

According to the mobile terminal and the adjusting method of the display interface, when the mobile terminal is fixed on the virtual reality equipment and the function of automatically adjusting the display interface is started, the contact area between the display screen and the VR equipment window is detected, and the position of the display interface in the display screen is determined according to the contact area. Therefore, the mobile terminal can adaptively adjust the position of the display interface in the display screen, so that the VR equipment can watch the displayed video or image in the optimal window, thereby enabling a user to have a better immersion effect and improving the use experience of the user.

Drawings

Fig. 1 is a schematic diagram of a hardware structure of an optional mobile terminal for implementing various embodiments of the present invention;

FIG. 2 is a diagram of a wireless communication system for the mobile terminal shown in FIG. 1;

fig. 3 to 5 are schematic structural diagrams of mobile terminals according to different embodiments of the present invention, which show the front side of the mobile terminal.

Fig. 6 is a schematic structural block diagram of a mobile terminal in the embodiment of the present invention.

FIG. 7 is a flowchart illustrating a method for adjusting a display interface according to an embodiment of the present invention.

The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.

The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.

Fig. 1 is a schematic hardware configuration of a mobile terminal implementing various embodiments of the present invention.

The mobile terminal 100 may include a wireless communication unit 110, an a/V (audio/video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190, etc. Fig. 1 illustrates a mobile terminal having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. Elements of the mobile terminal will be described in detail below.

The wireless communication unit 110 typically includes one or more components that allow radio communication between the mobile terminal 100 and a wireless communication system or network. For example, the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.

The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel may include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to a terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Also, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may exist in various forms, for example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB), an Electronic Service Guide (ESG) of digital video broadcasting-handheld (DVB-H), and the like. The broadcast receiving module 111 may receive a signal broadcast by using various types of broadcasting systems. In particular, the broadcast receiving module 111 may receive a broadcast signal by using a signal such as multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), digital video broadcasting-handheld (DVB-H), forward link media (MediaFLO)^@) A digital broadcasting system of a terrestrial digital broadcasting integrated service (ISDB-T), etc. receives digital broadcasting. The broadcast receiving module 111 may be configured to be suitable for providing various broadcast systems of broadcast signalsA system and the above digital broadcasting system. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).

The mobile communication module 112 transmits and/or receives radio signals to and/or from at least one of a base station (e.g., access point, node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received according to text and/or multimedia messages.

The wireless internet module 113 supports wireless internet access of the mobile terminal. The module may be internally or externally coupled to the terminal. The wireless internet access technology to which the module relates may include WLAN (wireless LAN) (Wi-Fi), Wibro (wireless broadband), Wimax (worldwide interoperability for microwave access), HSDPA (high speed downlink packet access), and the like.

The short-range communication module 114 is a module for supporting short-range communication. Some examples of short-range communication technologies include bluetooth^TMRadio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), zigbee^TMAnd so on.

The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of the location information module is a GPS (global positioning system). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information, thereby accurately calculating three-dimensional current location information according to longitude, latitude, and altitude. Currently, a method for calculating position and time information uses three satellites and corrects an error of the calculated position and time information by using another satellite. In addition, the GPS module 115 can calculate speed information by continuously calculating current position information in real time.

The a/V input unit 120 is used to receive an audio or video signal. The a/V input unit 120 may include a camera 121 and a microphone 122, and the camera 121 processes image data of still pictures or video obtained by an image capturing apparatus in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 151. The image frames processed by the cameras 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the construction of the mobile terminal. The microphone 122 may receive sounds (audio data) via the microphone in a phone call mode, a recording mode, a voice recognition mode, or the like, and can process such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the mobile communication module 112 in case of a phone call mode. The microphone 122 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The user input unit 130 may generate key input data according to a command input by a user to control various operations of the mobile terminal. The user input unit 130 allows a user to input various types of information, and may include a keyboard, dome sheet, touch pad (e.g., a touch-sensitive member that detects changes in resistance, pressure, capacitance, and the like due to being touched), scroll wheel, joystick, and the like. In particular, when the touch pad is superimposed on the display unit 151 in the form of a layer, a touch screen may be formed.

The sensing unit 140 detects a current state of the mobile terminal 100 (e.g., an open or closed state of the mobile terminal 100), a position of the mobile terminal 100, presence or absence of contact (i.e., touch input) by a user with the mobile terminal 100, an orientation of the mobile terminal 100, acceleration or deceleration movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling an operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide-type mobile phone, the sensing unit 140 may sense whether the slide-type phone is opened or closed. In addition, the sensing unit 140 can detect whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled with an external device. The sensing unit 140 may include a proximity sensor 1410 as will be described below in connection with a touch screen.

The interface unit 170 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The identification module may store various information for authenticating a user using the mobile terminal 100 and may include a User Identity Module (UIM), a Subscriber Identity Module (SIM), a Universal Subscriber Identity Module (USIM), and the like. In addition, a device having an identification module (hereinafter, referred to as an "identification device") may take the form of a smart card, and thus, the identification device may be connected with the mobile terminal 100 via a port or other connection means. The interface unit 170 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal and the external device.

In addition, when the mobile terminal 100 is connected with an external cradle, the interface unit 170 may serve as a path through which power is supplied from the cradle to the mobile terminal 100 or may serve as a path through which various command signals input from the cradle are transmitted to the mobile terminal. Various command signals or power input from the cradle may be used as signals for recognizing whether the mobile terminal is accurately mounted on the cradle. The output unit 150 is configured to provide output signals (e.g., audio signals, video signals, alarm signals, vibration signals, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.

The display unit 151 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 may display a User Interface (UI) or a Graphical User Interface (GUI) related to a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch pad are overlapped with each other in the form of a layer to form a touch screen, the display unit 151 may serve as an input device and an output device. The display unit 151 may include at least one of a Liquid Crystal Display (LCD), a thin film transistor LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as transparent displays, and a typical transparent display may be, for example, a TOLED (transparent organic light emitting diode) display or the like. Depending on the particular desired implementation, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown). The touch screen may be used to detect a touch input pressure as well as a touch input position and a touch input area.

The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 into an audio signal and output as sound when the mobile terminal is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output module 152 may provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 may provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alarm unit 153 may provide output in different ways to notify the occurrence of an event. For example, the alarm unit 153 may provide an output in the form of vibration, and when a call, a message, or some other incoming communication (incomingmunication) is received, the alarm unit 153 may provide a tactile output (i.e., vibration) to inform the user thereof. By providing such a tactile output, the user can recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 may also provide an output notifying the occurrence of an event via the display unit 151 or the audio output module 152.

The memory 160 may store software programs and the like for processing and controlling operations performed by the controller 180, or may temporarily store data (e.g., a phonebook, messages, still images, videos, and the like) that has been or will be output. Also, the memory 160 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 generally controls the overall operation of the mobile terminal. For example, the controller 180 performs control and processing related to voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 1810 for reproducing (or playing back) multimedia data, and the multimedia module 1810 may be constructed within the controller 180 or may be constructed separately from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power and provides appropriate power required to operate various elements and components under the control of the controller 180.

The various embodiments described herein may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, an electronic unit designed to perform the functions described herein, and in some cases, such embodiments may be implemented in the controller 180. For a software implementation, the implementation such as a process or a function may be implemented with a separate software module that allows performing at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in the memory 160 and executed by the controller 180.

Up to this point, mobile terminals have been described in terms of their functionality. Hereinafter, a slide-type mobile terminal among various types of mobile terminals, such as a folder-type, bar-type, swing-type, slide-type mobile terminal, and the like, will be described as an example for the sake of brevity. Accordingly, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

The mobile terminal 100 as shown in fig. 1 may be configured to operate with communication systems such as wired and wireless communication systems and satellite-based communication systems that transmit data via frames or packets.

A communication system in which a mobile terminal according to the present invention is operable will now be described with reference to fig. 2.

Such communication systems may use different air interfaces and/or physical layers. For example, the air interface used by the communication system includes, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)), global system for mobile communications (GSM), and the like. By way of non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.

Referring to fig. 2, the CDMA wireless communication system may include a plurality of mobile terminals 100, a plurality of Base Stations (BSs) 270, Base Station Controllers (BSCs) 275, and a Mobile Switching Center (MSC) 280. The MSC280 is configured to interface with a Public Switched Telephone Network (PSTN) 290. The MSC280 is also configured to interface with a BSC275, which may be coupled to the base station 270 via a backhaul. The backhaul may be constructed according to any of several known interfaces including, for example, E1/T1, ATM, IP, PPP, frame Relay, HDSL, ADSL, or xDSL. It will be understood that a system as shown in fig. 2 may include multiple BSCs 2750.

Each BS270 may serve one or more sectors (or regions), each sector covered by a multi-directional antenna or an antenna pointing in a particular direction being radially distant from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS270 may be configured to support multiple frequency allocations, with each frequency allocation having a particular frequency spectrum (e.g., 1.25MHz,5MHz, etc.).

The intersection of partitions with frequency allocations may be referred to as a CDMA channel. The BS270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" may be used to generically refer to a single BSC275 and at least one BS 270. The base stations may also be referred to as "cells". Alternatively, each sector of a particular BS270 may be referred to as a plurality of cell sites.

As shown in fig. 2, a Broadcast Transmitter (BT)295 transmits a broadcast signal to the mobile terminal 100 operating within the system. A broadcast receiving module 111 as shown in fig. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In fig. 2, several Global Positioning System (GPS) satellites 300 are shown. The satellite 300 assists in locating at least one of the plurality of mobile terminals 100.

In fig. 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information may be obtained with any number of satellites. The GPS module 115 as shown in fig. 1 is generally configured to cooperate with satellites 300 to obtain desired positioning information. Other techniques that can track the location of the mobile terminal may be used instead of or in addition to GPS tracking techniques. In addition, at least one GPS satellite 300 may selectively or additionally process satellite DMB transmission.

As a typical operation of the wireless communication system, the BS270 receives reverse link signals from various mobile terminals 100. The mobile terminal 100 is generally engaged in conversations, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within the particular BS 270. The obtained data is forwarded to the associated BSC 275. The BSC provides call resource allocation and mobility management functions including coordination of soft handoff procedures between BSs 270. The BSCs 275 also route the received data to the MSC280, which provides additional routing services for interfacing with the PSTN 290. Similarly, the PSTN290 interfaces with the MSC280, the MSC interfaces with the BSCs 275, and the BSCs 275 accordingly control the BS270 to transmit forward link signals to the mobile terminal 100.

The mobile terminal shown in fig. 3 is a schematic structural diagram of the front side of the mobile terminal 300 of the present invention.

The mobile terminal 300 includes: a display screen 301, the display screen 301 occupying almost the entire front face of the mobile terminal 300 such that there is no left bezel, right bezel, top bezel, and bottom bezel, which is a typical four-sided bezel-less structure. It should be noted that although in fig. 3, there is a certain gap between the top and bottom of the display 301 and the top and bottom of the mobile terminal 300, respectively, the gap is generally only in the range of millimeters, such as 5-9 mm (millimeters), such as in one embodiment, the distance between the top of the display 301 and the top of the mobile terminal 300 is only 6-7.3 mm (such as 6.5 mm). Such a narrow gap can be considered as a borderless structure to the industry.

In addition, the display 301 may occupy the entire front face of the mobile terminal 300 and extend into the side faces of the mobile terminal, even continuing to the back face of the mobile terminal. In addition, HOME keys 3011 may be virtually mapped within the display interface of display screen 301 for user manipulation.

The structure shown in fig. 3 is a four-sided frameless structure, but a three-sided frameless structure is not excluded by the present invention. For example, as shown in fig. 4 and 5, are schematic front views of the mobile terminal 300 in other embodiments, which illustrate a three-sided frameless structure. Specifically, as shown in fig. 4, the mobile terminal 300 is provided with a display screen 301 and an upper bezel 302 on the front surface thereof, without a lower bezel and left and right bezels. Since the upper frame 302 exists, a front camera (not shown) may be provided in the upper frame 302.

As shown in fig. 5, the front surface of the mobile terminal 300 includes: display screen 301 and lower border 303 without upper and left and right borders. Due to the presence of the lower rim 303, a front camera (not shown), a fingerprint sensor (not shown), and the like may be disposed within the lower rim 303.

Since the front surface of the mobile terminal 300 in fig. 3 has no bezel structure, when the mobile terminal 300 is fixed in the VR device, the mobile terminal can be freely placed in the VR device without being limited by the bezel. However, because the display interface is fixed, no frame is used as a reference, and the display interface can be positioned in a window of the VR device after being adjusted for many times; or when the display screen of the mobile terminal is large, the display interface cannot be matched with the window of the VR equipment, so that the use of the mobile terminal is limited. In view of the above, the embodiment of the present invention further provides a mobile terminal, so as to solve the problem that the four-side frameless mobile terminal cannot be matched with a virtual reality device window due to a fixed display interface.

As shown in fig. 6, the mobile terminal provided in the embodiment of the present invention specifically includes:

the detection unit 61 is used for detecting a contact area between the display screen and a VR equipment window when the mobile terminal is fixed on the virtual reality VR equipment and the function of automatically adjusting the display interface is started;

and the adjusting unit 62 is used for adjusting the position of the display interface in the display screen according to the contact area, so that the display interface is completely displayed in the window range of the VR device.

According to the mobile terminal provided by the embodiment of the invention, the size and the position of the VR equipment window can be obtained according to the contact area with the VR equipment, and the video or the image is displayed in the position area appointed by the display screen. Therefore, the mobile terminal of VR equipment can be more widely used by the invention and is not limited to the mobile terminal of a specific model; in addition, the complicated operation of the user in the process of adjusting the position of the mobile terminal is effectively reduced, and the use experience of the user is effectively improved.

Each module of the mobile terminal is described in detail below with reference to specific embodiments.

the fixing means here is not limited to a plug-in or clip-on type. The display screen of the mobile terminal needs to be larger than or equal to the size of the VR equipment window, so that the VR equipment can obtain the best viewing window.

After the mobile terminal is fixed to the VR device, if the detecting unit 61 detects that the user starts the display function, the function of automatically adjusting the display interface is started at the same time. When the function of automatically adjusting the display interface is turned on, the detection unit 61 detects a contact area between the display screen and a window of the VR device. The display interface refers to a display area occupied by the video or the image in the display screen.

Specifically, the display screen in the mobile terminal is a pressure touch display screen, so the detection unit 61 can know the contact area with the VR device window according to the pressure detected by the display screen. Wherein, when detecting unit 61 detects the contact area with the VR device window, it is specifically configured to:

judging whether the coordinates of each coordinate point accord with a preset rule or not:

when the judgment meets the preset rule, judging the region where each coordinate point is located as a contact region;

and when the preset rule is judged not to be met, displaying the display interface in the default area.

It can be known that, when the display screen contacts with the VR device window, the detection unit 61 obtains the pressure value of each coordinate point in the screen; and when the pressure value of the coordinate point is greater than a preset threshold value, judging that touch control exists at the coordinate point.

In order to avoid the influence of the false touch on the determination, the detection unit 61 needs to continuously determine whether the coordinate of the coordinate point of which the detected pressure value is greater than the preset threshold value meets the preset rule. The preset rule may be to determine whether the area where the coordinate points are located substantially coincides with the shape of the window, or may be to determine whether the distribution of the shapes of the windows of the coordinate points located at the corners conforms to the rule. When the detecting unit 61 judges that the preset rule is satisfied, the adjustment is performed by the adjusting unit 62.

When the detecting unit 61 determines that the coordinate point does not satisfy the preset rule, it indicates that the pressure borne by the current display screen is not generated by the contact of the VR device window, and the adjustment is not required according to the following adjustment method. The display may be performed in a default area. The default area may be the entire display screen or a display area pre-designated by a user, and the present invention is not limited specifically.

And when the mobile terminal adjusts the position of the display interface in the display screen according to the determined contact area, the position of the display interface in the display screen is obtained according to each coordinate point of the determined contact area.

Specifically, the adjusting unit 62 includes a determining module and an adjusting module; wherein,

the determining module is used for determining a non-contact area of the display screen within the range of the VR equipment window according to the coordinates of each coordinate point of the contact area;

Specifically, the determining module is configured to determine, according to coordinates of each coordinate point of the contact area, a non-contact area of the display screen within a window of the VR device, and specifically configured to:

acquiring each coordinate point of which the pressure value is smaller than a preset threshold value in an area surrounded by the coordinate points at the four corners;

the region where each coordinate point is located is a non-contact region.

Since the edges of the contact region are similar to rectangles, the coordinates of coordinate points located at four corners outside the contact region can be directly acquired. And obtaining each coordinate point of which the pressure value in the quadrilateral area formed by the four coordinate points is smaller than a preset threshold value. And the region where each coordinate point is located is a non-contact region in the window range. Generally, the non-contact area refers to an area of the mobile terminal which is covered by the window. Of course, there are special cases where the contact area is also included in the occlusion area.

The determining module may also determine coordinates of coordinate points at four corners inside the contact area, where an area surrounded by the four coordinate points is a non-contact area. The method for determining the non-contact area only according to the coordinates of the coordinate points at the four inner corners is relatively simple, but the determined area has relatively large error.

Wherein, the adjustment module adjusts the display interface to the position of the non-contact area, and is specifically configured to:

calculating the length and width of the non-contact area according to the coordinates of the non-contact area;

And when a non-contact area of the display screen in the range of the VR equipment window is determined, acquiring coordinates of each coordinate point in the non-contact area. And when the display interface is adjusted, calculating the length and the width of the non-contact area according to the coordinates of each coordinate point.

When the adjusting module calculates, the non-contact area needs to be determined as a rectangular area, four vertex coordinates of the rectangular area are obtained, and the length and the width of the non-contact area can be calculated according to the coordinates.

For example, when the coordinate of the four coordinate points located at the boundary in the non-contact region is determined as the rectangular region, for example, a (1,0), B (5,1), C (2,5), and D (3,4), the coordinates of the four vertices of the rectangular region are determined according to the coordinates of the four coordinate points, and two points of the four coordinate points whose abscissa and ordinate are in the middle (i.e., 2 and 3 on the abscissa and 1 and 4 on the ordinate) are taken, then the four coordinate points take the close abscissa and ordinate as the coordinates of the new coordinate point, and a '(2, 1), B' (3,1), C '(2, 4), and D' (3,4) can be obtained. And calculating the length and the width of the non-contact area according to the coordinate values of the new coordinate point, acquiring a display interface, respectively adjusting the display interface to the length and the width of the non-contact area, and displaying the display interface in the area determined by the new coordinate point.

Further, the adjusting module is further configured to adjust the display interface to the default display area of the mobile terminal when the detecting unit 61 detects that there is no contact area with the window of the VR device.

Based on the mobile terminal, an embodiment of the present invention further provides a method for adjusting a display interface, as shown in fig. 7, which specifically includes the following steps:

step 701, when the mobile terminal is fixed on VR equipment and the function of automatically adjusting the display interface is started, detecting a contact area between a display screen and a VR equipment window;

and step 702, determining the position of the display interface in the display screen according to the contact area, so that the display interface is completely displayed in the window range of the VR device.

According to the method for adjusting the display interface provided by the embodiment of the invention, the size and the position of the VR equipment window can be obtained by the mobile terminal according to the contact area of the mobile terminal and VR equipment, and a video or an image is displayed in the designated position area of the display screen. Therefore, the mobile terminal of VR equipment can be more widely used by the invention and is not limited to the mobile terminal of a specific model; in addition, the complicated operation of the user in the process of adjusting the position of the mobile terminal is effectively reduced, and the use experience of the user is effectively improved.

The specific procedures of the above steps will be described in detail with reference to specific examples.

Step 701, when the mobile terminal is fixed to the VR device and the function of automatically adjusting the display interface is started, detecting a contact area between the display screen and a window of the VR device.

After the mobile terminal is fixed to the VR equipment, if the display function is started by a user, the function of automatically adjusting the display interface is started at the same time. And when the function of automatically adjusting the display interface is started, detecting the contact area of the display screen and the VR equipment window. The display interface refers to a display area occupied by the video or the image in the display screen.

Specifically, the display screen in the mobile terminal is a pressure touch display screen, so that a contact area with a VR device window can be known according to pressure detected by the display screen. Wherein, when detecting the contact area with VR equipment window, specifically include:

Therefore, when the display screen is in contact with the VR equipment window, the pressure value of each coordinate point in the screen is obtained; and when the pressure value of the coordinate point is greater than a preset threshold value, judging that the point has touch control.

In order to avoid the influence of the false touch on the determination, it is necessary to continuously determine whether the coordinates of the coordinate point where the detected pressure value is greater than the preset threshold value satisfy the preset rule. The preset rule may be to determine whether the area where the coordinate points are located substantially coincides with the shape of the window, or may be to determine whether the distribution of the shapes of the windows of the coordinate points located at the corners conforms to the rule.

And when the coordinate point does not meet the preset rule, the pressure borne by the current display screen is not generated by the contact of the VR equipment window, and the adjustment is not required according to the following adjustment method. The display may be performed in a default area. The default area may be the entire display screen or a display area pre-designated by a user, and the present invention is not limited specifically.

And step 702, adjusting the position of the display interface in the display screen according to the contact area, so that the display interface is completely displayed in the window range of the VR device.

In the step, when the mobile terminal adjusts the position of the display interface in the display screen according to the determined contact area, the position of the display interface in the display screen is obtained according to each coordinate point of the determined contact area.

Specifically, a non-contact area of the display screen in a window range of the VR device needs to be determined according to coordinates of each coordinate point of the contact area; and adjusting the display interface to the position of the non-contact area.

The method for determining the non-contact area of the display screen in the VR equipment window range according to the coordinates of each coordinate point of the contact area specifically comprises the following steps:

the region where each coordinate point is located is a non-contact region.

Since the edges of the contact region are similar to rectangles, the coordinates of coordinate points located at four corners outside the contact region can be directly acquired. And obtaining each coordinate point of which the pressure value in the area surrounded by the four coordinate points is smaller than a preset threshold value. And the region where each coordinate point is located is a non-contact region in the window range.

The coordinate of the coordinate points at the four corners inside the contact area can be used, and the area surrounded by the four coordinate points is the non-contact area. The method for determining the non-contact area only according to the coordinates of the coordinate points at the four inner corners is relatively simple, but the determined area has relatively large error.

Wherein, adjusting the display interface to the position of the non-contact area specifically includes:

During calculation, the non-contact area needs to be determined as a rectangular area, four vertex coordinates of the rectangular area are obtained, and the length and the width of the non-contact area can be calculated according to the coordinates. When the coordinates of four coordinate points located at the boundary in the non-contact region are determined to be the rectangular region, for example, a (1,0), B (5,1), C (2,5), and D (3,4), coordinates of four vertices of the rectangular region are determined according to the coordinates of the four coordinate points, two points of the four coordinate points, in which the abscissa and the ordinate are in the middle (i.e., 2 and 3 are the abscissa and 1 and 4 are the ordinate), are taken, and then the four coordinate points take the close abscissa and the ordinate as the coordinates of the new coordinate point, and a '(2, 1), B' (3,1), C '(2, 4), and D' (3,4) can be obtained. And calculating the length and the width of the non-contact area according to the coordinate values of the new coordinate point, acquiring a display interface, respectively adjusting the display interface to the length and the width of the non-contact area, and displaying the display interface in the area determined by the new coordinate point.

Further, the method further comprises the step of adjusting the display interface to a default display area of the mobile terminal when the mobile terminal detects that no contact area exists between the mobile terminal and the window of the VR device.

In summary, according to the mobile terminal and the adjustment method of the display interface provided by the embodiments of the present invention, the size and the position of the window of the VR device are obtained according to the contact area between the mobile terminal and the VR device, so as to adaptively adjust the display position and the display size of the video or the image on the display screen. Therefore, the mobile terminal can be matched with various VR devices through the invention and is not limited by the limitation of specific adaptive models of the VR devices; the mobile terminal is adaptive to a window of the VR device, so that the VR device can watch the displayed video or image in the optimal window, and a user has a better immersion effect; in addition, the invention can effectively reduce the complicated operation when the user adjusts the fixed position of the mobile terminal and improve the use experience of the user.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims

1. A mobile terminal, comprising:

2. The mobile terminal of claim 1, wherein the display screen is a pressure touch display screen, and the detection unit is specifically configured to:

3. The mobile terminal of claim 2, wherein the adjusting unit comprises:

4. The mobile terminal of claim 3, wherein the determining module is specifically configured to:

5. The mobile terminal of claim 3, wherein the adjusting module is specifically configured to:

6. A method for adjusting a display interface is used in a mobile terminal, and is characterized by comprising the following steps:

7. The method according to claim 6, wherein the display screen is a pressure touch display screen, and when detecting a contact area between the display screen and the virtual reality device window, the method specifically comprises:

8. The method of claim 7, wherein the determining the position of the display interface in the display screen according to the contact position specifically comprises:

and adjusting the display interface to the position of the non-contact area.

9. The method of claim 8, wherein determining a non-contact area of the display screen within the virtual reality device window based on coordinates of respective coordinate points of the contact area comprises:

10. The method of claim 8, wherein the adjusting the display interface to the position of the non-contact area comprises: