TWI620099B - Method for determining display orientation and electronic apparatus using the same and computer readable recording medium - Google Patents

Abstract

A method of determining the direction in which a picture is displayed. The method includes the following steps. A plurality of contact points are sensed by at least one holding sensor, and a holding state of holding an electronic device is determined according to the contact points. At least one holding sensor is disposed on at least one side of the electronic device. The held direction of the electronic device being held is determined according to the grip state. The screen display direction of the screen generated by the electronic device is determined according to the held direction.

Description

Method for determining the direction of display of the screen and electronic device and computer readable using the same Record media

The present invention relates to a method and an electronic device for determining a direction, and more particularly to a method and an electronic device for determining a display direction of a screen.

With the advent of the multimedia era, the field of application of display devices has expanded. A wide variety of electronic devices having display devices have become well known and widely used. People often read text or enjoy pictures through electronic devices, and can watch videos through electronic devices. Electronic devices having display devices typically have two screen modes, a portrait mode and a landscape mode. Generally, the electronic device automatically determines the screen mode through the sensing signal of the inertial sensor (such as a gravity sensor (G-sensor)). The function of the electronic device to automatically determine the screen mode is also called auto orientation. However, if the screen of the electronic device is parallel to the ground (for example, if the user uses the electronic device while lying down), the gravity sensor cannot correctly determine the direction, causing the electronic device to display the screen using the wrong screen mode. For example, the user holds the electricity in a lateral manner The sub-device, while the electronic device displays the picture in an upright mode; or the user holds the electronic device in a straight manner, while the electronic device displays the picture in a erect mode. Therefore, how to correctly judge the display direction of the electronic device has become one of the current efforts of the industry.

According to an embodiment of the present invention, a method of determining a display direction of a screen is proposed. The method includes the following steps. The plurality of contact points are sensed by the at least one grip sensor, and a grip state of the electronic device is determined according to the contact points. At least one holding sensor is disposed on at least one side of the electronic device. The held direction of the electronic device being held is determined according to the grip state. The screen display direction of the screen generated by the electronic device is determined according to the held direction.

According to another embodiment of the present invention, an electronic device having a function of determining a display direction of a screen is provided. The electronic device includes at least one grip sensor and a processor. The at least one holding sensor is disposed on at least one side of the electronic device for sensing a holding state of the holding electronic device. The processor is configured to determine a direction in which one of the held electronic devices is held according to the grip state, and determine a screen display direction of one of the screens generated by the electronic device according to the held direction.

The disclosure further provides a computer readable recording medium for recording one or more programs, after the one or more programs are loaded into an electronic device and executed, the one or more programs cause the electronic device to execute the above The method.

The invention is described in detail below with reference to the accompanying drawings.

100, 200, 300, 400‧‧‧ electronic devices

102‧‧‧ Holding sensor

104, 208, 308‧‧‧ processor

106, 206, 306‧‧‧ display unit

202, 302‧‧‧First holding sensor

204, 304‧‧‧Second holding sensor

S402, S404, S406, S1202, S1204, S1206, S1902, S1904, S1906, S1908, S1910‧‧‧ process steps

502‧‧‧ left hand

504‧‧‧ right hand

404‧‧‧First sound input unit

406‧‧‧First sound output unit

408‧‧‧First distance sensor

4010‧‧‧Second sound input unit

412‧‧‧Second sound output unit

414‧‧‧Second distance sensor

600‧‧‧virtual reality device

D1‧‧‧First held in the direction

D2‧‧‧The second is held in the direction

S1‧‧‧ first side

S2‧‧‧ second side

S3‧‧‧ third side

S4‧‧‧ fourth side

L1, R1‧‧‧ thumb

L2, R2‧‧‧ index finger

L3, R3‧‧‧ middle finger

L4, R4‧‧‧ ring finger

L5, R5‧‧‧ Little Finger

PL1, PR1‧‧‧ palm

M1‧‧‧ midline

A1‧‧‧ first area

A2‧‧‧Second area

L1', L2', L3', L4', L5', R1', R2', R3', R4', R5'‧‧‧ finger position

PL1’, PR1’‧‧‧ palm position

FIG. 1 is a block diagram of an electronic device having a function of determining a screen display direction according to an embodiment.

2 is a plan view of the electronic device according to the first embodiment of the embodiment.

FIG. 3 is a plan view of the electronic device according to FIG. 1 according to another embodiment.

FIG. 4 is a flow chart showing a method of determining a display direction of a screen according to an embodiment of the present invention.

Figure 5 is a schematic diagram showing the left and right hands of the user.

FIG. 6A is a schematic diagram showing the electronic device of FIG. 2 held by the left hand.

FIG. 6B is a schematic diagram showing the position of the finger and the position of the palm sensed by the grip sensor in FIG. 6A.

FIG. 7A is a schematic diagram showing the electronic device of FIG. 2 held by the right hand in another holding direction.

FIG. 7B is a schematic diagram showing the position of the finger and the position of the palm sensed by the grip sensor in FIG. 7A.

FIG. 7C illustrates an example in which the electronic device is held in the erect mode.

FIG. 7D illustrates another example in which the electronic device is held in the erect mode.

FIG. 8 is a block diagram of an electronic device having a function of determining a display direction of a screen according to another embodiment.

Figure 9 is a plan view of the electronic device of Figure 8.

FIG. 10 is a flow chart showing a method of determining a display direction of a screen according to another embodiment of the present invention.

FIG. 11A is a schematic diagram showing the electronic device of FIG. 9 held by the left hand.

FIG. 11B is a schematic diagram showing the position of the finger and the position of the palm sensed by the first grip sensor and the second grip sensor in FIG. 11A.

FIG. 12A is a schematic diagram showing the electronic device of FIG. 9 held by the right hand.

FIG. 12B is a schematic diagram showing the position of the finger and the position of the palm sensed by the first grip sensor and the second grip sensor in FIG. 12A.

FIG. 12C illustrates an example in which the electronic device is held in the erect mode.

Fig. 12D is a diagram showing another example in which the electronic device is held in the erect mode.

FIG. 13A is a schematic diagram showing the electronic device of FIG. 9 held by the left hand.

FIG. 13B is a schematic diagram showing the position of the finger and the position of the palm sensed by the first grip sensor and the second grip sensor in FIG. 13A.

FIG. 14A is a schematic diagram showing the electronic device of FIG. 9 held by the right hand.

FIG. 14B is a schematic diagram showing the position of the finger and the position of the palm sensed by the first grip sensor and the second grip sensor in FIG. 14A.

FIG. 15 is a block diagram of an electronic device having a function of determining a display direction of a screen according to another embodiment.

Figure 16 is a plan view showing the electronic device of Figure 15.

FIG. 17 is a flow chart showing a method of determining a display direction of a screen according to an embodiment of the present invention.

FIG. 18A is a schematic view showing the electronic device of FIG. 16 held by the left hand.

FIG. 18B is a schematic diagram showing the position of the finger and the position of the palm sensed by the first grip sensor and the second grip sensor in FIG. 18A.

19 is a top plan view of an electronic device in accordance with another embodiment.

Figure 20 is a schematic diagram showing the output screen of the virtual reality device.

Please also refer to Figures 1, 2 and 3. FIG. 1 is a block diagram of an electronic device 100 having a function of determining a screen display direction according to an embodiment. FIG. 2 is a plan view of the electronic device 100 according to the first embodiment of the embodiment. FIG. 3 is a plan view of the electronic device 100 according to FIG. 1 according to another embodiment. The electronic device 100 includes a grip sensor 102, a processor 104, and a display unit 106. The grip sensor 102 and the display unit 106 are coupled to the processor 104. The grip sensor 102 is, for example, a pressure sensor, a capacitive sensor, a resistive sensor, or an ultrasonic sensor, but is not limited thereto, as long as the touch position of the finger is sensed. The sensor is all right. The display unit 106 is configured to display a screen, and the display unit 106 is, for example, a liquid crystal display. The electronic device 100 is, for example, a tablet computer or a smart phone. The first side S1 and the second side S2 are short sides of the electronic device 100, and the third side S3 and the fourth side S4 are long sides of the electronic device 100. The holding sensor 102 is disposed on the third side S3 or the fourth side S4 of the electronic device 100 for sensing a holding state of at least one long side of the electronic device 100. The gripping state includes contacting the finger position or palm position of the grip sensor 102. The holding sensor of the present invention can also be disposed on at least one short side of the electronic device according to actual needs, and the invention is not limited thereto.

Please refer to FIG. 4, which illustrates a flow chart of a method for determining a display direction of a screen according to an embodiment of the present invention. The method of determining the display direction of the screen can be applied to the electronic device 100 as shown in FIG. 2 or FIG.

First, in step S402, multiple sensors are sensed by the grip sensor 102. At the contact point, the processor 104 determines the holding state of the holding electronic device 100 based on the plurality of contact points. The gripping state includes the relative relationship of at least one finger position and palm position on the grip sensor 102. Specifically, when the grip sensor 102 senses a point contact point, the processor 104 can determine that the point contact point is a finger contact, and the position of the point contact point is a finger position; when the grip feeling When the detector 102 senses a piece of contact, the processor 104 can determine that the contact point of the sheet is the contact of the palm, and the position of the contact point of the sheet is the position of the palm. The processor 104, for example, resolves the point contact and the sheet contact point through the area of the contact point to discern the contact of the finger or the contact of the palm. Alternatively, the grip sensor 102 includes a plurality of small units, and the processor 104 resolves the point contact points and the sheet contact points according to the number of contacted small units to discriminate the contact of the finger or the contact of the palm.

Please refer to Figures 5 and 6. FIG. 5 is a schematic diagram showing the left hand 502 and the right hand 504 of the user. The left hand 502 includes a thumb L1, an index finger L2, a middle finger L3, a ring finger L4, a little finger L5, and a palm PL1. The right hand 504 includes a thumb R1, an index finger R2, a middle finger R3, a ring finger R4, a little finger R5, and a palm PR1. FIG. 6A is a schematic diagram showing the left hand 502 holding the electronic device 100 of FIG. 2 . FIG. 6B is a schematic diagram showing the position of the finger and the position of the palm sensed by the grip sensor 102 in FIG. 6A. In FIG. 6A, the thumb L1 of the left hand 502 and the palm PL1 contact the third side S3, and the index finger L2 of the left hand, the middle finger L3, the ring finger L4, and the little finger L5 contact the fourth side S4. In FIG. 6B, the grip sensor 102 senses the point contact point L1' and the sheet contact point PL1', and the processor 104 determines that the point contact point L1' is the finger position, and the sheet contact point PL1' For the palm position.

Please refer to Figure 7. FIG. 7A is a schematic diagram showing the right hand 504 holding the electronic device 100 of FIG. 2 in another holding direction. FIG. 7B is a schematic diagram showing the position of the finger and the position of the palm sensed by the grip sensor 102 in FIG. 7A. In FIG. 7A, the right hand 504 holds the electronic device 100 in another holding direction, the thumb R1 of the right hand 504 and the palm PR1 contact the third side S3, the index finger R2 of the right hand 504, the middle finger R3, the ring finger R4 and the little finger R5 are in contact. Fourth side S4. In FIG. 7B, the grip sensor 102 senses the point contact point R1' and the one-piece contact point PR1', and the processor 104 determines that the point contact point R1' is the finger position, and the sheet contact point PR1' For the palm position.

In step S404, the processor 104 determines the held direction of the electronic device 100 being held according to the grip state. In the present invention, the held direction may include a first held direction and a second held direction. The first held direction is, for example, that the first side S1 points upward with respect to the second side S2. The second held direction is, for example, that the first side S1 points downward with respect to the second side S2. For a more clear description of the first and second held directions, refer to FIGS. 6A and 7A in sequence, FIG. 6A illustrates the first held direction D1 of the electronic device 100, and FIG. 7A illustrates the electronic The second direction of device 100 is held in direction D2.

Further, the processor 104 determines a thumb position based on the relative relationship between the finger position and the palm position, and determines the held direction of the electronic device 100 according to the thumb position. The manner in which the processor 104 determines the position of the thumb based on the relative relationship between the position of the finger and the position of the palm is as follows. Taking the 6A and 6B diagrams as an example, the grip sensor 102 senses the point contact point and the sheet contact point, and the processor 104 determines the plurality of connections. At least one of the contacts in the contacts corresponds to at least one finger position L1' and one of the plurality of contact points corresponds to a palm position PL1'. Since the thumb and the palm contact the same side of the electronic device 100 when the user holds the electronic device 100, the processor 104 can thereby determine the same side of the palm position PL1' (ie, the grip sensor 102). The finger position L1' on the finger is a thumb position. Next, after the processor 104 obtains the position of the thumb, the held position of the electronic device 100 is determined according to the relative position of the thumb position and the palm position on the grip sensor 102. The way is as follows. The grip sensor 102 has a preset coordinate, and the processor 104 can obtain the coordinate setting manner of the grip sensor 102 in advance. The setting manner is, for example, that the coordinate minimum value of the grip sensor 102 is set close to the second side S2, and the coordinate maximum value is set close to the first side S1. The processor 104 determines that the coordinate of the thumb position L1' is located between the coordinates of the palm position PL1' and the coordinate maximum value according to the coordinates of the palm position PL1', the coordinates of the thumb position L1', the coordinate maximum value, and the coordinate minimum value. It is located between the coordinates of the palm position PL1' and the coordinate minimum to determine the direction in which the electronic device 100 is held. In this example, the processor 104 determines that the coordinate of the thumb position L1' is between the coordinate of the palm position PL1' and the coordinate maximum value, so the processor 104 determines that the held direction of the electronic device 100 is the first grip. Hold direction D1.

Similarly, taking the 7A and 7B diagrams as an example, the processor 104 determines that the coordinates of the thumb position R1' are between the coordinates of the palm position PR1' and the coordinate minimum, so the processor 104 determines the held direction of the electronic device 100. The second direction is held in the direction D2.

In step S406, the processor 104 determines the electron according to the direction of being held. The screen display direction of the screen generated by the device 100. Referring to FIGS. 6A and 6B, when the processor 104 determines that the electronic device 100 is held in the first held direction D1, the processor 104 displays the direction in an upright position (relative to the first side S1). The screen is displayed in the display unit 106. Referring to FIGS. 7A and 7B, when the processor 104 determines that the electronic device 100 is held in the second held direction D2, the processor 104 displays the direction in an inverted screen (relative to the first side S1). A screen is displayed in the display unit 106. In this manner, even if the electronic device 100 is held upside down, the electronic device 100 can appropriately adjust the displayed screen display direction according to the held direction.

Therefore, when the grip sensor 102 senses the position of the finger and the position of the palm, the present embodiment can estimate the position of the thumb according to the position of the finger sensed by the grip sensor 102 and the position of the palm. The direction in which the electronic device 100 is held is determined based on the position of the thumb, and is used as a basis for displaying the direction of the screen to accurately display the screen.

In an embodiment, the processor 104 can determine whether the electronic device 100 is held in the upright mode according to the sensing result of the holding sensor 102. If not, it is determined to maintain the automatic rotating screen function (refer to the electronic device 100 based on The function of the inertial sensor automatically starts the function of rotating the screen). For example, when the processor 104 determines that the electronic device 100 is being held in the traverse mode, the automatic rotation screen function of the electronic device 100 will be maintained. Please refer to FIGS. 7C and 7D. FIG. 7C illustrates an example in which the electronic device 100 is held in the erect mode, and FIG. 7D illustrates another example in which the electronic device 100 is held in the erect mode. Generally, when the user wants to view the display screen of the electronic device 100 in the traverse mode, the electronic device 100 is normally held. The manner is as shown in FIGS. 7C and 7D, so when the processor 104 senses only two point contact points by the grip sensor 102, it can be judged that the electronic device 100 is held in the erect mode. On the other hand, when the processor 104 determines that the electronic device 100 is held in the upright mode (such as the holding mode shown in FIG. 6A or FIG. 7A), the function of automatically rotating the screen of the electronic device 100 is turned off to avoid The user lying down using the electronic device causes the electronic device 100 to automatically rotate the screen erroneously, causing inconvenience in use.

The aspect of the present invention is the same as that of the first embodiment, and the first side S1 and the second side S2 refer to the short side of the electronic device 100 and the third side. The side S3 and the fourth side S4 refer to the long sides of the electronic device 100, and the descriptions of the following embodiments will not be repeated.

Please also refer to Figures 8 and 9. FIG. 8 is a block diagram of an electronic device 200 having a function of determining a screen display direction according to another embodiment. FIG. 9 is a plan view of the electronic device 200 of FIG. 8. The electronic device 200 includes a first grip sensor 202, a second grip sensor 204, a display unit 206, and a processor 208. The first grip sensor 202 , the second grip sensor 204 , and the display unit 206 are coupled to the processor 208 . The first holding sensor 202 and the second holding sensor 204 are respectively disposed on the third side S3 and the fourth side S4 for sensing the holding state of the long side of the electronic device 200. The gripping state includes contacting a finger position or a palm position of the first grip sensor 202 and the second grip sensor 204.

Please refer to FIG. 10, which illustrates a flow chart of a method for determining a display direction of a screen according to another embodiment of the present invention.

First, in step S1202, the first grip sensor 202 and the second grip sensor 204 sense a plurality of contact points, and the processor 208 determines the grip state of the grip electronic device 200 according to the plurality of contact points. . The gripping state includes the relative relationship between the at least one finger position and the palm position on the first grip sensor 202 and the second grip sensor 204.

Please refer to Figures 11 and 12. FIG. 11A is a schematic diagram showing the left hand 502 holding the electronic device 200 of FIG. FIG. 11B is a schematic diagram showing the position of the finger and the position of the palm sensed by the first grip sensor 202 and the second grip sensor 204 in FIG. 11A. FIG. 12A is a schematic diagram showing the electronic device 200 of the right hand 504 holding the ninth figure. FIG. 12B is a schematic diagram showing the position of the finger and the position of the palm sensed by the first grip sensor 202 and the second grip sensor 204 in FIG. 12A. In FIG. 11A, the palm PL1 of the left hand 502 contacts the third side S3, the index finger L2 of the left hand, the middle finger L3, the ring finger L4 and the little finger L5 contact the fourth side S4, and the left hand thumb L1 does not touch the electronic device 200. On either side. In Fig. 11B, the first grip sensor 202 senses a palm position PL1', and the second grip sensor 204 senses four finger positions L2', L3', L4', and L5'. In FIG. 12A, the palm PR1 of the right hand 504 contacts the fourth side S4, the index finger R2 of the right hand, the middle finger R3, the ring finger R4 and the little finger R5 contact the third side S3, and the right hand thumb R1 does not touch the electronic device 200. On either side. In Fig. 12B, the first grip sensor 202 senses four finger positions R2', R3', R4', and R5', and the second grip sensor 204 senses a palm position PR1'.

In step S1204, the processor 208 determines to be held according to the grip state. The electronic device 200 is held in the direction of being held. Specifically, the processor 208 determines the direction in which the electronic device 200 is held according to the center of gravity of the finger position and the center of gravity of the palm position. The center of gravity is, for example, the average of the coordinates corresponding to the position. The first grip sensor 202 and the second grip sensor 204 have preset coordinates, and the processor 208 can obtain the setting manner of the coordinates of the grip sensor 102 in advance. For example, the coordinate minimum values of the first grip sensor 202 and the second grip sensor 204 are set close to the second side S2, and the coordinate maximum value is set close to the first side S1. Taking the 11A and 11B diagrams as an example, the processor 208 calculates the center of gravity of the four finger positions L2', L3', L4', and L5' and the center of gravity of the palm position PL1', that is, calculates the four finger positions L2', L3'. The average of the coordinates corresponding to L4' and L5' and the coordinates of the coordinates corresponding to the palm position PL1'. The processor 208 then determines whether the coordinates of the center of gravity of the finger positions L2', L3', L4', and L5' are closer to the coordinate minimum or coordinate maximum than the coordinates of the center of gravity of the palm position PL1'. If the coordinates of the center of gravity of the finger positions L2', L3', L4', and L5' are closer to the coordinate maximum than the coordinates of the center of gravity of the palm position PL1', the processor 208 determines that the held direction of the electronic device 200 is the first Hold direction D1. If the coordinates of the center of gravity of the finger positions L2', L3', L4', and L5' are closer to the coordinate minimum than the coordinates of the center of gravity of the palm position PL1', the processor 208 determines that the held direction of the electronic device 200 is the second Hold direction D2. In FIG. 11, the coordinates of the center of gravity of the finger positions L2', L3', L4', and L5' are closer to the coordinate maximum than the coordinates of the center of gravity of the palm position PL1', and the processor 208 determines that the electronic device 200 is held. The direction is the first held direction D1. In Fig. 12, the coordinates of the center of gravity of the finger positions R2', R3', R4', and R5' are also closer to the coordinates than the coordinates of the center of gravity of the palm position PR1'. The processor 208 determines that the held direction of the electronic device 200 is also the first held direction D1. Although the present embodiment takes four finger positions as an example, it is not limited thereto. As long as the first grip sensor 202 or the second grip sensor 204 senses at least one finger position, and the processor 208 can calculate the center of gravity according to the at least one finger position and determine the center of gravity of the finger position and the center of gravity of the palm position. The relative relationship can be.

In another embodiment, the processor 208 determines the direction in which the electronic device 200 is held according to the relative relationship between the position of the finger and the position of the palm, and does not determine the center of gravity of the position of the finger and the center of gravity of the position of the palm to determine the electronic device 200. Being held in the direction.

The manner in which the processor 208 determines the held direction of the electronic device 200 based on the relative relationship between the finger position and the palm position is as follows. Taking the 11A and 11B diagrams as an example, the processor 208 can determine the four finger positions L2 according to the coordinate interval in which the four finger positions L2', L3', L4', and L5' are located and the coordinate interval in which the palm position PL1' is located. Whether at least one of the standard intervals in which ', L3', L4', and L5' is located is closer to the coordinate minimum or the coordinate maximum relative to the coordinate interval in which the palm position PL1' is located. If the coordinate interval at which the at least one finger position is located is closer to the coordinate maximum value with respect to the coordinate interval of the palm position PL1', the processor 208 determines that the held direction of the electronic device 200 is the first held direction D1. If the coordinate interval in which at least one finger position is located is closer to the coordinate minimum value with respect to the coordinate interval in which the palm position PL1' is located, the processor 208 determines that the held direction of the electronic device 200 is the second held direction D2. In Fig. 11, the coordinate positions at which the finger positions L2' and L3' are located are smaller than the palm position PL1'. When the coordinate interval is closer to the coordinate maximum value, the processor 208 determines that the held direction of the electronic device 200 is the first held direction D1. In Fig. 12, the coordinate positions in which the finger positions R2' and R3' are located are also closer to the coordinate maximum than the coordinate interval in which the palm position PR1' is located, and the processor 208 determines that the held direction of the electronic device 200 is also the first. The direction D1 is held. Although the present embodiment takes four finger positions as an example, it is not limited thereto. The first grip sensor 202 or the second grip sensor 204 senses at least one finger position, and the processor 208 can determine the relative relationship between the finger position and the palm position according to the at least one finger position.

In step S1206, the processor 208 determines the screen display direction of the screen generated by the electronic device 200 according to the held direction. For example, as shown in FIGS. 11A and 11B, when the processor 208 determines that the electronic device 200 is held in the first held direction D1, the processor 208 displays the direction in an upright position (relative to the first The side S1) displays a picture in the display unit 206. On the other hand, when the processor 208 determines that the electronic device 200 is held in the second held direction D2, the processor 208 displays the direction (relative to the first side S1) on the display unit 206 in an inverted screen. The screen is displayed.

In this way, even if the user does not touch the electronic device 200 while holding the electronic device 200, the at least one finger position and the palm of the hand can be sensed by the grip sensors disposed on both sides of the electronic device 200. The position is used to estimate the manner in which the user holds the electronic device 200, and the relative position of the at least one finger position and the palm position is used to determine the direction in which the electronic device 200 is held, as a basis for the screen display direction to accurately display the screen.

Similarly, the processor 208 can also determine whether the electronic device 100 is held in the upright mode according to the sensing result of the holding sensors 202 and 204. If not, it is determined to maintain the automatic rotating screen function (refer to the electronic device 100 based on The function of the inertial sensor automatically starts the function of rotating the screen). For example, please refer to FIGS. 12C and 12D. FIG. 12C illustrates an example in which the electronic device 200 is held in the erect mode, and FIG. 12D illustrates another example in which the electronic device 200 is held in the erect mode. In an embodiment, if the user holds the electronic device 200 in the holding manner as shown in FIGS. 12C and 12D, the processor 208 can sense four by holding the sensor 202 and the grip sensor 204. With the point contact point, it can be judged that the electronic device 100 is held in the erect mode, and the automatic rotation screen function is maintained correspondingly.

Please refer to Figures 13 and 14. FIG. 13A is a schematic diagram showing the left hand 502 holding the electronic device 200 of FIG. FIG. 13B is a schematic diagram showing the position of the finger and the position of the palm sensed by the first grip sensor 202 and the second grip sensor 204 in FIG. 13A. FIG. 14A is a schematic diagram showing the right hand 504 holding the electronic device 200 of FIG. FIG. 14B is a schematic diagram showing the position of the finger and the position of the palm sensed by the first grip sensor 202 and the second grip sensor 204 in FIG. 14A. In Fig. 13A, the palm PL1 of the left hand 502 contacts the third side S3, the index finger L2 of the left hand, the middle finger L3, and the ring finger L4 contact the fourth side S4. In FIG. 13B, the first grip sensor 202 senses a palm position PL1', and the second grip sensor 204 senses three finger positions L2', L3', and L4', and the palm position The PL1' and the three finger positions L2', L3', and L4' are all close to the same side of the electronic device 200 (that is, the second side S2). In Figure 14A, the palm of the right hand 504 PR1 contacts the fourth The side S4, the index finger R2 of the right hand, the middle finger R3 and the ring finger R4 contact the third side S3. In FIG. 14B, the first grip sensor 202 senses three finger positions R2', R3' and R4', the second grip sensor 204 senses a palm position PR1', and the palm position PR1' and the three finger positions R2', R3' and R4' are all close to the same side of the electronic device 200 (i.e., the second side S2).

In another embodiment, in step S1202, the first grip sensor 202 and the second grip sensor 204 sense the finger position and the palm position of the holding electronic device 200 as shown in FIGS. 13A and 14A. That is, both the finger position and the palm position are located in the same sensing area of the electronic device 200. Then, in step S1204, the processor 208 determines the direction in which the electronic device 200 is held according to the sensing area of the center of gravity of the finger position and the center of gravity of the palm position.

Specifically, the processor 208 can divide the sensing areas of the first grip sensor 202 and the second grip sensor 204, determine the sensing area of the center of gravity of the finger position and the center of the palm position, and sense the sense The side area determines the direction in which the electronic device 200 is held. For example, as shown in FIGS. 13B and 14B, the sensing regions of the first grip sensor 202 and the second grip sensor 204 can be divided into two equally sized regions according to the midline m1. That is, based on the midline m1, the sensing area of the first grip sensor 202 is divided into a sensing area near the first side S1 and a sensing area near the second side S2; the second holding The sensing area of the sensor 204 is divided into a sensing area near the first side S1 and a sensing area near the second side S2.

Next, the processor 208 determines the center of gravity and the palm position of the finger position. The center of gravity is in the sensing area where the first grip sensor 202 and the second grip sensor 204 are located. Taking FIG. 13B as an example, if the processor 208 determines that the center of gravity of the palm position PL1' is located near the sensing area of the second side S2 and the center of gravity of the finger positions L2', L3', and L4' is located near the second side S2. The sensing area determines that the held direction of the electronic device 200 is the first held direction D1. Taking FIG. 14B as an example, if the processor 208 determines that the center of gravity of the palm position PR1' is located near the sensing area of the second side S2 and the center of gravity of the finger positions R2', R3', and R4' is located near the second side S2. The sensing area determines that the held direction of the electronic device 200 is the first held direction D1. On the other hand, if the processor 208 determines that the center of gravity of the palm position and the center of gravity of the at least one finger position are located near the sensing area of the first side S1, it is determined that the held direction of the electronic device 200 is the second held direction D2. Although the embodiment uses three finger positions as an example, it is not limited thereto. As long as the first grip sensor 202 or the second grip sensor 204 senses at least one finger position, and the processor 208 can determine the sensing sensed according to the center of gravity of the at least one finger position and the center of gravity of the palm position. The area is fine.

In this way, when the palm position and the finger position are all close to the same side, the center of gravity of the finger position and the center of gravity of the palm position may be located at the first grip sensor 202 and the second grip sensor 204. The sensing area determines the direction in which the electronic device 200 is held, and determines the screen display direction according to the held direction to correctly display the screen.

Please also refer to Figures 15 and 16. FIG. 15 is a block diagram of an electronic device 300 having a function of determining a screen display direction according to another embodiment. First 16 is a top plan view of the electronic device 300 of FIG. The electronic device 300 includes a first grip sensor 302, a second grip sensor 304, a display unit 306, a processor 308, and a fingerprint recognizer 310. The first grip sensor 302 , the second grip sensor 304 , the display unit 306 , and the fingerprint identifier 310 are coupled to the processor 308 . The first grip sensor 302 and the second grip sensor 304 are respectively disposed on the long sides of the electronic device 300. The gripping state includes contacting a finger position or a palm position of the first grip sensor 302 and the second grip sensor 304. The fingerprint identifier 310 is disposed on one of the long sides of the electronic device 300 for recognizing the fingerprint of the finger. For example, as shown in FIG. 16, the fingerprint recognizer 310 is disposed at the fourth side S4. In another embodiment, the electronic device 300 can include two fingerprint identifiers disposed on the two long sides of the electronic device 300. The present invention does not limit the position and number of the fingerprint recognizer 310 disposed on the electronic device 300.

Please refer to FIG. 17. FIG. 17 is a flow chart showing a method for determining a display direction of a screen according to an embodiment of the present invention. In this example, processor 308 first determines if the palm position is sensed. Next, the fingerprint of the finger is recognized by the fingerprint reader 310 to distinguish the finger. Then, the processor 308 determines the direction in which the electronic device 300 is held according to the recognized finger, and determines the screen display direction of the screen produced by the electronic device 300 according to the held direction.

In step S1902, the processor 308 determines whether the first grip sensor 302 or the second grip sensor 304 senses the palm position. When the first grip sensor 302 or the second grip sensor 304 senses the sheet contact point, the processor 308 determines that the palm position is sensed, and proceeds to step S1904. When the palm position is not sensed, then End the process. Please refer to FIGS. 18A and 18B. FIG. 18A is a schematic diagram showing the left hand 502 holding the electronic device 300 of FIG. FIG. 18B is a schematic diagram showing the position of the finger and the position of the palm sensed by the first grip sensor 302 and the second grip sensor 304 in FIG. 18A. In Fig. 18A, the palm PL1 and the thumb L1 of the left hand 502 contact the third side S3, and the index finger L2, the middle finger L3, the ring finger L4, and the little finger L5 of the left hand 502 contact the fourth side S4. In Fig. 18B, the first grip sensor 302 senses the position of the palm PL1'.

In step S1904, a finger is recognized by the fingerprint recognizer 310. Specifically, the electronic device 300 can pre-store the fingerprints of the fingers of the user as the comparison identification. Referring to FIG. 18B, the fingerprint reader 310 senses the fingerprint of the finger of the finger position L3', and recognizes the finger as the middle finger L3 of the left hand 502 according to the fingerprint of each pre-stored finger.

In step S1906, the processor 308 determines the held direction of the electronic device 300 being held according to the finger recognized by the fingerprint recognizer 310. In an embodiment, the fingerprint identifier 310 is disposed on the fourth side S4 of the electronic device 300. If the processor 308 recognizes that the finger is one of the index finger L2, the middle finger L3, the ring finger L4, and the little finger L5 of the left hand 502, the processor 308 may determine that the held direction of the electronic device 300 is the first held direction D1. If the recognized finger is one of the index finger R2, the middle finger R3, the ring finger R4, and the little finger R5 of the right hand 504, the processor 308 may determine that the held direction of the electronic device 300 is the second held direction D2. In another embodiment, the fingerprint identifier 310 is disposed on the third side S3 of the electronic device 300 (not shown). If the processor 308 recognizes that the finger is the thumb of the left hand 502 L1, the processor 308 determines that the held direction of the electronic device 300 is the first held direction D1. If the recognized finger is the thumb R1 of the right hand 504, the processor 308 may determine that the held direction of the electronic device 300 is the second held direction D2.

In step S1908, the processor 308 displays the direction of the screen of the screen generated by the electronic device 300 according to the direction of the grip.

In this way, when the first grip sensor 302 or the second grip sensor 304 senses the palm position, the finger recognized by the fingerprint reader 310 can determine the held direction of the electronic device 300. The screen display direction is determined according to the direction of the grip to correctly display the screen.

Please refer to FIG. 19 , which illustrates a top view of an electronic device 400 in accordance with another embodiment. The electronic device 400 includes a display unit 402, a first sound input unit 404, a first sound output unit 406, a first proximity sensor 408, a second sound input unit 410, a second sound output unit 412, and a second Distance sensor 414. The first sound input unit 404 and the second sound input unit 410 may be, for example, a microphone. The first sound output unit 406 and the second sound output unit 412 can be, for example, an earpiece or a horn. The first sound input unit 404, the first sound output unit 406, and the first distance sensor 408 are disposed in one of the first area A1 of the electronic device 400, the second sound input unit 410, the second sound output unit 412, and the second distance. The sensor 414 is disposed in a second area A2 of the electronic device 400. The first area A1 and the second area A2 are respectively close to opposite sides of the electronic device 400. For example, the first area A1 is close to the first side S1, and the second area A2 is close to the second side S2. In an embodiment, the processor 308 selects according to the direction of being held. The first sound input unit 404, the first sound output unit 406, the first distance sensor 408, the second sound input unit 410, the second sound output unit 412, and the second distance sensor 414 are selectively enabled. More specifically, when the processor 308 determines that the electronic device 400 is held in the first held direction D1, the processor 308 enables the first sound output unit 406 in the first area A1, the first distance. The sensor 408 and the second sound input unit 410 in the second area A2. Conversely, when the processor 308 determines that the electronic device 400 is held in the second held direction D2, the processor 308 enables the second sound output unit 412 in the second area A2, and the second distance sensing. The 414 and the first sound input unit 404 in the first area A1.

The electronic devices in the above embodiments, for example, the electronic devices 100, 200, and 300 may be a virtual reality (VR) device, and the above-mentioned screen may be a screen output by the virtual reality device. Please refer to FIG. 20, which shows a schematic diagram of the virtual reality device 600. The user holds a hand-held object, such as a wood of a mobile phone shape (not shown). The processor and the grip sensor in the foregoing embodiments may be disposed in the wood and perform the method of determining the display direction of the screen in the foregoing embodiment. After the processor determines the direction in which the wood is held, the processor determines the image display corresponding to the position of the wood in the screen of the virtual reality device 600 according to the direction of being held. For example, the processor displays a cell phone image corresponding to the location of the wood in the screen of the virtual reality device 600. Therefore, the user can see in the screen of the virtual reality device 600 that the hand is holding the mobile phone instead of the wood.

In another embodiment, the processor can maintain the auto-rotation screen function according to the type of application currently executed by the electronic device (or do not perform the foregoing The method for determining the direction in which the screen is displayed is described in the example). For example, when a specific application (for example, a camera application) is turned on, the method of determining the display direction of the screen in the foregoing embodiment is not performed. In this way, when the user uses a specific application, the direction of the screen display can be prevented from affecting the user.

Based on the above, the present invention senses the grip state of the holding electronic device according to the grip sensor, determines the held direction of the held electronic device according to the grip state, and finally determines the screen of the display screen according to the gripped direction. Show direction. Therefore, even if the screen of the electronic device is parallel to the ground, the gripping direction can be correctly determined according to the grip sensor, and the screen can be displayed in the correct screen display direction. Therefore, it is possible to more effectively improve the problem that the screen display direction of the screen is wrong, and let the user view the screen in the correct screen display direction.

Numerous modifications and other embodiments of the inventions set forth herein will be apparent to those skilled in the <RTIgt; Therefore, it is to be understood that the invention is not intended to be

Claims (14)

A method for determining a display direction of a screen, comprising: sensing a plurality of contact points by at least one holding sensor, and determining, according to the contact points, a holding state of holding an electronic device, wherein the The at least one holding sensor is disposed on at least one side of the electronic device; determining a held direction of the held electronic device according to the holding state; determining the electronic device according to the held direction Generating a screen display direction of one of the screens; determining whether the electronic device is held in an upright mode according to the sensing result of the at least one grip sensor; and maintaining the electronic device when being held in the non-upright mode The electronic device is based on the sensing result of an inertial sensor to correspondingly activate the function of automatically rotating the auto orientation. The method of claim 1, wherein the step of determining the held direction of the electronic device according to the holding state is based on the at least one finger and the palm of the hand at the at least one holding sensor The relative position of the upper device determines the held direction of the electronic device. The method of claim 1, further comprising: determining that at least one of the contact points corresponds to at least one finger position and the one of the contact points corresponds to a palm position Determining that the finger position on the grip sensor where the palm position is located is one a position of the thumb; and determining the held direction of the electronic device according to the position of the thumb and the relative position of the position of the palm on the grip sensor. The method of claim 1, further comprising: maintaining an automatic rotating screen function of the electronic device according to an application type currently executed by the electronic device. The method of claim 1, wherein the electronic device has a fingerprint identifier, the method further comprising: identifying at least one finger fingerprint by the fingerprint identifier; and simultaneously selecting the contact point and the at least one finger The fingerprint determines the holding state of the electronic device. The method of claim 1, wherein the electronic device further comprises a first sound input unit, a first sound output unit, a first distance sensor, a second sound input unit, and a second a sound output unit and a second distance sensor, the first sound input unit, the first sound output unit and the first distance sensor are disposed in a first area of the electronic device, and the second sound input unit The second sound output unit and the second distance sensor are disposed on a second area of the electronic device, and the first area and the second area are respectively located on opposite sides of the electronic device, and the method further includes Enabling the first sound output unit, the first distance sensor and the second sound input unit or the second sound output unit, the second distance sensor, and the first sound according to the held direction Input unit. A computer readable recording medium recording one or more programs, after the one or more programs are loaded into an electronic device and executed, the one or more programs cause the electronic device to execute as claimed The method according to any one of the items 1 to 7. An electronic device having a function of determining a display direction of a screen, comprising: at least one holding sensor disposed on at least one side of the electronic device for sensing a plurality of contact points; and a processor for determining according to the The contact point determines a holding state of the electronic device, determines a held direction of the held electronic device according to the holding state, and determines a picture generated by the electronic device according to the held direction a screen display direction; and a display unit for displaying the screen, the processor determining, according to the sensing result of the at least one grip sensor, whether the electronic device is held in an upright mode, when the processor determines the When the electronic device is held in the non-upright mode, the electronic device is maintained according to the sensing result of the inertial sensor to correspondingly activate the function of automatically rotating the screen. The electronic device of claim 8, wherein the processor is configured to determine the held direction of the electronic device according to a relative position of the at least one finger and the palm of the hand on the at least one holding sensor. The electronic device of claim 8, wherein the processor is further configured to determine that at least one of the contact points corresponds to at least one finger position and one of the contact points Corresponding to a palm position, and determining that the finger position on the grip sensor where the palm position is located is a thumb position And determining the held direction of the electronic device according to the position of the thumb and the relative position of the palm position on the grip sensor. The electronic device of claim 8, wherein the at least one grip sensor comprises a first grip sensor and a second grip sensor, the first grip sensor and The second holding sensors are respectively disposed on the first side and the second side of the opposite side of the electronic device, and the first side and the second side are the long sides of the electronic device. The electronic device of claim 8, wherein the processor maintains an automatic rotating screen function of the electronic device according to an application type currently executed by the electronic device. The electronic device of claim 8, wherein the electronic device has a fingerprint identifier for recognizing at least one finger fingerprint; wherein the processor simultaneously determines the grip according to the contact points and the at least one finger fingerprint The holding state of the electronic device. The electronic device of claim 8, wherein the electronic device further comprises a first sound input unit, a first sound output unit, a first distance sensor, a second sound input unit, and a first a second distance sensor and a second sound output unit, the first sound input unit, the first distance sensor and the first sound output unit are disposed in a first area of the electronic device, the second sound input The second distance sensor and the second sound output unit are disposed in a second area of the electronic device, and the first area and the second area are respectively located on opposite sides of the electronic device; The processor is configured to enable the first sound output unit, the first distance sensor, the second sound input unit or the second sound output unit, the second distance sensor, and the second sound sensor according to the held direction The first sound input unit.