CN109218599B

CN109218599B - Panoramic image display method and electronic device thereof

Info

Publication number: CN109218599B
Application number: CN201710540635.4A
Authority: CN
Inventors: 王昱翔; 李俊贤
Original assignee: Acer Inc
Current assignee: Acer Inc
Priority date: 2017-07-05
Filing date: 2017-07-05
Publication date: 2021-06-01
Anticipated expiration: 2037-07-05
Also published as: CN109218599A

Abstract

The invention provides a display method of a panoramic image and an electronic device thereof, wherein the method is suitable for the electronic device with a screen and an input device and comprises the following steps. And acquiring a panoramic image, and performing face recognition on the panoramic image to recognize a plurality of key faces from the panoramic image. And displaying the preset area of the panoramic image and the graphic representations respectively corresponding to the key human faces on a display picture of a screen. And in response to the detection of the selection operation of the user on the first icon by using the input device, displaying a first area where a first key face corresponding to the first icon is located on the display screen.

Description

Display method of panoramic image and electronic device thereof

Technical Field

The invention relates to a display method of a panoramic image and an electronic device thereof.

Background

With the development of science and technology, various intelligent image acquisition devices, such as tablet computers, personal digital assistants, smart phones and the like, have become indispensable tools for modern people. The camera lens carried by the high-level intelligent image acquisition device is comparable to or even can replace the traditional consumer camera, and a few high-level intelligent image acquisition devices have pixel and image quality close to a digital monocular or provide more advanced functions and effects.

Taking a 360-degree panoramic camera as an example, it can capture all details of 360 degrees to make the picture look as if it were. However, when the user is viewing the photos, it often takes a lot of time to adjust the viewing angle of each photo to find the position of the important object in the photo.

Disclosure of Invention

In view of the above, the present invention provides a method for displaying a panoramic photo and an electronic device thereof, which enable a user to have intuitive and fast operation and viewing experience when viewing a panoramic image.

In an embodiment of the present invention, the method for displaying a panoramic photo is applied to an electronic device having a screen and an input device and includes the following steps. And acquiring a panoramic image, and performing face recognition on the panoramic image to recognize a plurality of key faces from the panoramic image. And displaying the preset area of the panoramic image and the graphic representations respectively corresponding to the key human faces on a display picture of a screen. And in response to the detection of the selection operation of the user on the first icon by using the input device, displaying a first area where a first key face corresponding to the first icon is located on the display screen.

In an embodiment of the invention, the electronic device includes a screen, an input device, a memory and a processor, wherein the processor is coupled to the screen, the input device and the memory. The screen is used for displaying pictures. The input device is used for detecting the operation of the electronic device. The memory is used for storing data. The processor is used for obtaining a panoramic image, performing face recognition on the panoramic image to recognize a plurality of key faces from the panoramic image, displaying a preset area of the panoramic image and icons respectively corresponding to the key faces on a display screen of a screen, and displaying a first area where a first key face corresponding to a first icon is positioned on the display screen in response to detecting that a user utilizes an input device to select the first icon.

In order to make the aforementioned and other features and advantages of the invention more comprehensible, embodiments accompanied with figures are described in detail below.

Drawings

Fig. 1 is a block diagram of an electronic device according to an embodiment of the invention.

Fig. 2 is a flowchart illustrating a display method of a panoramic image according to an embodiment of the present invention.

Fig. 3A to 3B are display scenarios of a panoramic image according to an embodiment of the present invention.

Fig. 4A to 4B are display scenarios of a panoramic image according to an embodiment of the present invention.

Description of the reference numerals

100: electronic device

110: touch screen

120: memory device

130: processor with a memory having a plurality of memory cells

S202 to S208: step (ii) of

I1-I4: illustration of the drawings

HF 1-HF 4: human face

P: portrayal

R1, R3, R3': display area

F: finger(s)

Detailed Description

Some embodiments of the invention will now be described in detail with reference to the drawings, wherein like reference numerals are used to refer to like or similar elements throughout the several views. These examples are only a part of the present invention and do not disclose all possible embodiments of the present invention. Rather, these embodiments are merely exemplary of the methods and electronic devices claimed herein.

Fig. 1 is a block diagram of an electronic device according to an embodiment of the invention, which is for convenience of illustration and is not intended to limit the invention. First, fig. 1 first describes all the components and the configuration of the electronic device, and the detailed functions will be disclosed together with fig. 2.

Referring to fig. 1, an electronic device 100 includes a screen 110, an input device 115, a memory 120, and a processor 130. In the present embodiment, the electronic device 100 may be a computer system such as a personal computer, a notebook computer, a smart phone, a tablet computer, a personal digital assistant, etc., and acquires a panoramic image from another image acquisition device for displaying according to the proposed method. In another embodiment, the electronic device 100 itself may be, for example, a digital camera, a digital video camera, a monocular camera, a smart phone, a tablet computer, a personal digital assistant, a tablet computer, etc. with a panoramic image capturing function, which is not limited herein.

The screen 110 is used for displaying the image outputted by the electronic device 100 for the user to view. In the present embodiment, the screen 110 is, for example, a Liquid Crystal Display (LCD), a Light-Emitting Diode (LED) Display, a Field Emission Display (FED), or other types of displays.

The input device 115 is used for providing a user with operations on the electronic device 100, and may be a keyboard, a mouse, a stylus pen, a touch pad, a track ball, etc. externally connected to or built in the electronic device 100. In one embodiment, the screen 110 and the input device 115 may be integrated into a touch screen, such as a capacitive or resistive touch screen, for receiving a touch operation of a user with a finger, a palm or other objects.

The memory 120 is used for storing images and data, and may be any type of fixed or removable Random Access Memory (RAM), read-only memory (ROM), flash memory (flash memory), hard disk, or the like, or a combination thereof.

The processor 130 is coupled to the screen 110, the input device 115 and the memory 120, and is used for integrating the overall operation of the electronic device 100, and may be, for example, a Central Processing Unit (CPU), or other programmable general purpose or special purpose microprocessor (microprocessor), a Digital Signal Processor (DSP), a programmable controller, an Application Specific Integrated Circuit (ASIC), a Programmable Logic Device (PLD), or other similar devices or combinations thereof. After the panoramic image is obtained, the processor 130 performs the proposed display method flow.

Fig. 2 is a flowchart illustrating a method for displaying a panoramic image according to an embodiment of the present invention, and the method flow of fig. 2 may be implemented by various elements of the electronic apparatus 100 of fig. 1.

Referring to fig. 1 and fig. 2, first, the processor 130 of the electronic device 100 acquires a panoramic image (step S202). Here, the processor 130 may receive the acquired panoramic image from an image acquisition module (not shown) of the electronic device 100 itself or from another image acquisition device. The panoramic image may be a 180 degree, 360 degree, 720 degree panoramic photograph or a movie.

Next, the processor 130 performs face recognition on the panoramic image to identify a plurality of key faces from the panoramic image (step S204). The processor 130 may select key faces from all faces according to the size and/or position of each face after recognizing the face from the panoramic image by using a face recognition technology of computer vision.

In one embodiment, the processor 130 may filter the important objects by sorting the recognized faces according to size, so as to set the large-sized faces as key faces and the small-sized faces as unimportant faces.

In one embodiment, the processor 130 may filter the key objects according to the angle of the face recognized relative to the camera lens and the vertical position information. For example, assuming that the camera lens is preset to be at a front by 90 degrees, faces near 90 degrees or so will be set as key faces and faces further away from 90 degrees will be set as insignificant faces.

Based on the size limitation of the screen 110, the processor 130 can only display a portion of the panoramic image on the display screen, and the portion of the panoramic image is a predetermined area, which can be, for example, a region right in front of the camera lens. When the key object is located in an area outside the preset area, the user cannot know whether the key object exists or whether the user needs to spend time to find the position of the key object when watching the panoramic image. Therefore, the processor 130 can utilize the selected key faces for navigation purposes to display the preset area of the panoramic image and the icons respectively corresponding to the key faces on the display screen of the screen 110 (step S206). The diagrams can be interactive objects in any shape, and the corresponding key faces are presented in each diagram to quickly guide the user to the emphasis of the panoramic image. In addition, the icons may be displayed on the edge of the display to avoid interfering with the user's viewing of the panoramic image.

Next, the processor 130 continuously detects whether the user selects any icon, and in response to detecting that the user selects the first icon using the input device 115, the processor 130 displays a first area where the first key face corresponding to the first icon is located on the display screen (step S208). That is, when the user selects the first icon, the display screen is shifted from the preset area of the panoramic area to the first area where the first key face is located, so that the user can quickly view the selected key object.

Fig. 3A to 3B and fig. 4A to 4B are display scenarios of a panoramic image according to an embodiment of the present invention.

In the present embodiment, it is assumed that the screen 110 and the input device 115 are integrated into a touch screen. When the user turns on the panoramic image to view, the display will display the preset region R1 and the icons I1-I4 of the panoramic image as shown in fig. 3A, wherein the icons I1-I4 are associated with the key faces HF 1-HF 4, only the key faces HF1, HF3, HF4 are located in the preset region R1, and the key face HF1 is located in the middle of the preset region R1. However, the key face HF4 is actually a face in the image P and is not a key object of the captured image, so the processor 130 can provide the user with a delete operation for the icons I1-I4 to allow the user to delete icons that are not key objects. It is assumed that the user wants to delete icon I4, and the processor 130 removes the icon I4 from the display screen as shown in fig. 3B after detecting that the user's finger F performs a deletion operation with respect to the icon I4.

Then, assuming that the user wants to completely view the key face HF3 corresponding to the icon I3, after detecting that the user performs a selection operation on the icon I3, the processor 130 displays a region R3 of the panoramic image as shown in fig. 4A, wherein the key faces HF1, HF2 and HF3 are all located in the predetermined region R3, and the key face HF3 is located in the middle of the region R3. Here, the processor 130 may provide a user with a dragging operation on the display screen, so that the user may manually adjust the display screen. Assuming that the user wants to view the key face HF2 completely, the processor 130 detects that the user's finger F drags the display, and the display will display the region R3' of the panoramic image as shown in fig. 4B, so as to display the key face HF2 completely.

In one embodiment, the electronic device 100 further includes a communication module, and the memory 120 further stores a contact list of the user, wherein the contact list includes a plurality of contacts and images and information thereof. The processor 130 may associate the identified key face with a contact image of the contact to transmit the panoramic image to the contact associated with the key face through the communication module. Here, the processor 130 may transmit the panoramic image according to the contact information (e.g. email, newsletter, chat software account) of the contact, so as to achieve instant sharing of the image.

In one embodiment, when a different contact receives the panoramic image transmitted from the electronic device 100, the electronic device displays different areas of the panoramic image. For example, in fig. 3B, when the contact (called "first contact") associated with the key face HF1 turns on the panoramic image by using its own electronic device, the region R1 is displayed, i.e., the face of the first contact is located in the center of the region R1. Taking fig. 4A as an example, when the contact (referred to as the "third contact") associated with the key face HF3 turns on the panoramic image by using its own electronic device, the contact will display the region R3, i.e., the face of the third contact will be located in the center of the region R3.

In summary, the method for displaying a panoramic image and the electronic device thereof provided by the present invention first perform key face recognition on the panoramic image to display the icon corresponding to the key face on the display screen, and detect a selection operation of the user on the icon to automatically move the display screen to the position of the key face corresponding to the selected icon. The invention can provide a user with fast browsing the key points in the panoramic image, so that the user can have intuitional and fast operation and watching experience when watching the panoramic image.

Although the present invention has been described with reference to the above embodiments, it should be understood that various changes and modifications can be made therein by those skilled in the art without departing from the spirit and scope of the invention.

Claims

1. A method for displaying panoramic images, characterized in that it is applicable to an electronic device having a screen and an input device, the method comprising the following steps:

obtain the panoramic image;

performing face recognition on the panoramic image to identify a plurality of key faces from the panoramic image;

displaying a preset area of the panoramic image and a plurality of images corresponding to the key faces on the display screen of the screen; and

In response to detecting the user's selection operation on the first icon of the icon by using the input device, displaying a first area corresponding to the first key face of the first icon on the display screen ,

Wherein, the electronic device further stores a contact list with a plurality of contacts, each of the contacts has a contact image, and the method further includes:

using the contact image, associating the key face with the contact; and

transmitting the panoramic image to the contact associated with the key face,

Wherein, the contact includes a first contact associated with the first key face, and the step of transmitting the panoramic image to the contact associated with the key face further includes:

Sending the panoramic image to the first contact, wherein when the first contact opens the received panoramic image using a first electronic device, the first electronic device displays the panoramic image. first area.

2. The method according to claim 1, wherein the step of performing face recognition on the panoramic image to identify the key face from the panoramic image comprises:

performing face recognition on the panoramic image to identify a plurality of faces from the panoramic image; and

According to the size of each of the faces, the key faces are selected from the faces.

3. The method according to claim 1, wherein the step of performing face recognition on the panoramic image to identify the key face from the panoramic image comprises:

According to the position information where each of the faces is located, the key faces are screened from the faces.

4. The method according to claim 1, wherein, after the step of performing face recognition on the panoramic image to identify the key face from the panoramic image, the method further comprises:

The second icon is removed from the display in response to detecting a deletion operation by the user of a second icon of the icon using the input device.

5. The method of claim 1, further comprising:

In response to detecting a drag operation on the display screen by the user using the input device, another area of the panoramic image is displayed on the display screen according to the drag operation.

6. An electronic device, characterized in that, comprising:

screen to provide a display screen;

an input device for detecting operations on the electronic device;

memory to store data;

communication module;

A processor, coupled to the screen, the input device and the memory, is used to perform the following steps:

get a panoramic image;

Displaying a preset area of the panoramic image and a plurality of images corresponding to the key faces on the display screen; and

Wherein, the memory also stores a contact list with a plurality of contacts, each of the contacts has a contact image, and the processor further performs the following steps:

using the contact image, associating the key face with the contact; and

transmitting the panoramic image to the contact person associated with the key face through the communication module,

Wherein, the contact includes a first contact associated with the first key face, and the processor transmits the panoramic image to the contact associated with the key face through the communication module The steps also include:

7 . The electronic device according to claim 6 , wherein, in response to detecting that the user uses the input device to delete a second icon of the icon, the processor automatically executes the The second icon is removed from the display screen, and in response to detecting the user's drag operation on the display screen by using the input device, the processor displays the panorama image according to the drag operation. Another area is on the display screen.