[go: up one dir, main page]

WO2019128139A1 - Systems and method for navigating a viewer within a live streaming of a place - Google Patents

Systems and method for navigating a viewer within a live streaming of a place Download PDF

Info

Publication number
WO2019128139A1
WO2019128139A1 PCT/CN2018/091426 CN2018091426W WO2019128139A1 WO 2019128139 A1 WO2019128139 A1 WO 2019128139A1 CN 2018091426 W CN2018091426 W CN 2018091426W WO 2019128139 A1 WO2019128139 A1 WO 2019128139A1
Authority
WO
WIPO (PCT)
Prior art keywords
viewer
place
live streaming
scanned images
navigation options
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2018/091426
Other languages
French (fr)
Inventor
Seng Fook LEE
Zhaoyun WANG
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Grandeur International Exhibition Group Co Ltd
Original Assignee
Guangdong Grandeur International Exhibition Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Grandeur International Exhibition Group Co Ltd filed Critical Guangdong Grandeur International Exhibition Group Co Ltd
Publication of WO2019128139A1 publication Critical patent/WO2019128139A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/003Navigation within 3D models or images
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Definitions

  • inventions relate to the field of three-dimensional (3D) imaging systems. More specifically, embodiments of the present disclosure relate to systems and methods for navigating a viewer while viewing a three-dimensional live streaming of a place.
  • An exhibition can be a demonstration or public display of works of arts, items of interest that may be held in a museum or an art gallery, or at a trade fair.
  • exhibitions have a fixed venue and fixed timings.
  • most of the exhibitions have a limit on maximum number of people who can come to see the exhibitions due to many limitations such as a size of the venue, timing, and so forth.
  • timing of the exhibition doesn’t suits them, or may be venue for the exhibition is far from their location. Therefore, many people who would want to view the exhibition sometimes are not able to view it due to these limitations.
  • the present disclosure provides a system for navigating a viewer within a three-dimensional (3D) live streaming of a place.
  • the present disclosure provides a method for navigating a viewer within a three-dimensional (3D) live streaming of a place.
  • the present disclosure provides a system for navigating a viewer within a three-dimensional (3D) live streaming of a place by presenting the viewer with one or more navigation options.
  • the present disclosure provides a method for navigating a viewer within a three-dimensional (3D) live streaming of a place by presenting the viewer with one or more navigation options.
  • the present disclosure provides a system for presenting a three-dimensional live streaming to viewers along with one or more navigation options via a virtual 3D display system.
  • the viewer may view the 3D live streaming of the place by using at least one of a web-based system, a virtual reality system, an augmented reality system and the like.
  • the present disclosure provides a method presenting a three-dimensional live streaming to viewers along with one or more navigation options via a virtual 3D display system.
  • the viewer may view the 3D live streaming of the place by using at least one of a web-based system, a virtual reality system, an augmented reality system and the like.
  • the present disclosure provides a method for superimposing a two-dimensional live streaming with a plurality of 3D scanned images for generating 3D live streaming.
  • the 3D live streaming is presented to the viewer along with one or more navigation options for guiding the viewer within the 3D live stream of the place.
  • the viewer may select at least one of the navigation options.
  • he present disclosure provides a method for superimposing a two-dimensional live streaming with a plurality of 3D scanned images for generating 3D live streaming.
  • the 3D live streaming is presented to the viewer along with one or more navigation options for guiding the viewer within the 3D live stream of the place.
  • the viewer may select at least one of the navigation options.
  • the present disclosure provides a method for enabling a viewer to view a 3D live streaming of a place by using a virtual 3D system, an augmented reality system, a virtual reality system, and a web-based display system.
  • the present disclosure provides a system for enabling a viewer to view a 3D live streaming of a place by using a virtual 3D system, an augmented reality system, a virtual reality system, and a web-based display system.
  • the present disclosure provides a navigation system for presenting a 3D live streaming of the place along with one or more navigation options to a viewer.
  • the navigation options may comprise a option for moving right, moving left, moving forward, moving backward, viewing a 360-degree view of the place, and so forth.
  • the viewer may select at least one of the navigation options.
  • the navigation options may be presented as one or more arrows within the 3D live streaming.
  • the present disclosure provides a navigation method for presenting a 3D live streaming of the place along with one or more navigation options to a viewer.
  • the navigation options may comprise a option for moving right, moving left, moving forward, moving backward, viewing a 360-degree view of the place, and so forth.
  • the viewer may select at least one of the navigation options.
  • the navigation options may be presented as one or more arrows within the 3D live streaming
  • An embodiment of the present disclosure provides a live streaming system for navigating a viewer, comprising: a database configured to store a plurality of three-dimensional (3D) scanned images of a place, wherein the plurality of 3D scanned images are captured by a plurality of scanners to cover a 360 degree view of the place; a superimposing module configured to: retrieve the plurality of pre-stored 3D scanned images of the place from the database; and generate a 3D live streaming of the place by superimposing a two-dimensional live stream of the place with the plurality of pre-stored 3D scanned images; and a display managing module configured to present the 3D live streaming along with one or more navigation options to the viewer, the one or more navigation options guides the viewer within the 3D live stream of the place, the viewer selects at least one of the one or more navigation options.
  • a database configured to store a plurality of three-dimensional (3D) scanned images of a place, wherein the plurality of 3D scanned images are captured by a plurality of scanners
  • the 3D live streaming along with the navigation options is generated and presented to the viewer in real-time.
  • the plurality of 3D scanned images are pre-captured and pre-stored in the database.
  • the viewer based on a valid login credential for viewing the 3D live streaming of the place
  • the 3D live streaming is presented to the viewer via at least one of a web based system, a virtual 3D display system, an augmented reality device, /system and a virtual reality device/system.
  • the database is further configured to store and maintain users’login credential information, pre-stored 3D scanned images, history of the viewer, interest of the viewer, navigation information, details about one or more products/services, information of the plurality of exhibition/place, virtual 3D display, the plurality of scanned images, one or more past activities of the viewer while viewing the virtual 3D display.
  • the database is located on a remote device comprising a server.
  • the three-dimensional live streaming and/or the virtual display of the place is presented to the viewer via at least one of a web based system, an augmented reality device and a virtual reality device.
  • the viewer views the virtual 3D display of the place via a web browser.
  • the virtual 3D display is presented to the viewer in real-time.
  • the navigation system 106 is also configured to generate a two-dimensional live stream of the place.
  • the virtual 3D display is viewed in non-real time.
  • the plurality of 3D scanned images are stored in a database located on a remote device comprising a server.
  • the navigation options comprises an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place.
  • a navigation system for guiding a viewer in a virtual 3D view of a place, comprising: a database configured to store a plurality of three-dimensional (3D) scanned images of the place, wherein the plurality of 3D scanned images are captured by a plurality of scanners to cover a 360 degree view of the place; a superimposing module configured to superimpose a two-dimensional live stream of the place with the plurality of pre-stored 3D scanned images for generating a 3D live streaming of the place; a display managing module configured to present the 3D live streaming along with one or more navigation options to a viewer, the one or more navigation options guides the viewer within the 3D live stream of the place based on one or more activities of the viewer, the viewer selects at least one of the one or more navigation options, further wherein the one or more navigation options comprising an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place and a navigation module for guiding the viewer within the 3D
  • the one or more activities of the viewer comprising a time spent at a particular position by the viewer, current interest of the viewer in a product/service, gestures of the viewer, and so forth.
  • the 3D live streaming is viewed by the viewer via a web based system, an augmented reality device, a virtual reality device, and the like.
  • Another embodiment of the present disclosure provides a method for navigating a viewer, comprising: storing a plurality of three-dimensional (3D) scanned images of the place in a database, wherein the plurality of 3D scanned images are captured by a plurality of scanners to cover a 360 degree view of the place; retrieving the plurality of pre-stored 3D scanned images of the place from the database; generating a 3D live streaming of the place by superimposing a two-dimensional live stream of the place with the plurality of pre-stored 3D scanned images; and presenting the 3D live streaming along with one or more navigation options to the viewer, the one or more navigation options guides the viewer within the 3D live stream of the place, the viewer selects at least one of the one or more navigation options.
  • 3D three-dimensional
  • the method comprises capturing the plurality of 3D images of the place for covering a 360-degree view of the place.
  • the viewer is authorized based on a valid login credential for viewing the 3D live streaming of the place.
  • the place can be an exhibition comprising display of a number of products and services.
  • a yet another embodiment of the present disclosure provides a navigation method for guiding a viewer in a virtual 3D view of a place, comprising: storing a plurality of three-dimensional (3D) scanned images of the place, wherein the plurality of 3D scanned images are captured by a plurality of scanners to cover a 360 degree view of the place; superimposing a two-dimensional live stream of the place with the plurality of pre-stored 3D scanned images for generating a 3D live streaming of the place; presenting the 3D live streaming along with one or more navigation options to a viewer, the one or more navigation options guides the viewer within the 3D live stream of the place based on one or more activities of the viewer, the viewer selects at least one of the one or more navigation options, further wherein the one or more navigation options comprising an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place; and guiding the viewer within the 3D live stream of the place based on a selection of the at least one of the
  • FIG. 1 illustrates an exemplary environment where various embodiments of the present disclosure may function
  • FIG. 2 illustrates a block diagram depicting various system elements of an exemplary live streaming system, in accordance with various embodiments of the present disclosure.
  • FIG. 3 illustrates a flowchart of a method for guiding a viewer in a three-dimensional (3D) live stream of a place, in accordance with an embodiment of the present disclosure.
  • FIG. 1 illustrates an exemplary environment 100 where various embodiments of the present disclosure may function.
  • the environment 100 primarily includes a viewer 102, a computing device 104 comprising a navigation system 106, and a server 108.
  • the viewer 102 may register with the navigation system 106 by entering one or more personal details such as a name, an age, a location, a gender, and so forth on an interface of the computing device 104.
  • the viewer 102 can be any user with authorized login credentials for accessing virtual view of a place such as, but not limited to, an exhibition by using the navigation system 106 and at least one of an augmented reality device/system, a web based system, or/and a virtual reality device/system.
  • the navigation system 106 may allow the viewer 102 to view a virtual 3D live stream and/or a virtual 3D display of a place such as, an exhibition on the computing device 104 by entering the valid login credentials from anywhere and at anytime. Further, the viewer 102 may not be required to physically visit the exhibition for viewing it.
  • the viewer 102 may be presented with a three-dimensional (3D) live streaming and/or three-dimensional (3D) virtual display including a virtual view of the exhibition/place by the navigation system 106 such that the viewer 102 may feel as being part of the exhibition/place and virtually may feel the environment of the exhibition or the place.
  • the examples of the exhibition may include a painting exhibition, a museum exhibition, a product exhibition, a service exhibition, and so forth. Further, an exhibition may be a display of products or services in an indoor area such as a hall, or in an outdoor area such as a ground.
  • the navigation system 106 may be an application installed on the computing device 104.
  • the viewer 102 may access the navigation system 106 via a website URL on a web browser such as, but not limited to, Google Chrome, Internet Explorer, and so forth on the computing device 104.
  • the navigation system 106 may be a single device or combination or multiple device or modules or systems capable of analyzing data generated during such as, a session of the viewer 102 while viewing the virtual 3D view and/or a three-dimensional (3D) live streaming of the place/exhibition. Further, the navigation system 106 may be software, hardware, firmware, and combination of these.
  • the computing device 104 may be such as, but not limited to, a smart phone, a tablet computer, a television, a laptop, a smart watch, a smart TV, a computer, and so forth.
  • the navigation system 106 is configured to authorize the viewer 102 based on a valid login credentials. Further, the navigation system 106 is configured to present a 3D live streaming of a place to the viewer 102 such that the viewer 102 feels as being part of the virtual 3D display. In some embodiments, the navigation system 106 is configured to present a virtual 3D view or display of the place to the viewer 102 such that the viewer 102 feels as being part of the virtual 3D display. The viewer 102 can feel one or more products for display in the virtual 3D display/3D live streaming of the place. The virtual 3D display may comprise a plurality of scanned images of the place captured by one or more scanners.
  • the virtual 3D display is presented to the viewer 102 via at least one of a web based system, an augmented reality device and a virtual reality device/system.
  • the viewer 102 may view the 3D live stream by using a virtual 3D display system, a virtual reality system, a web-based display system, an augmented reality system, and the like.
  • the navigation system 106 is further configured to sense a movement, behavior, one or more activities of the viewer 102, a current interest of the viewer in a product/service in the first virtual 3D display, and/or one or more gestures of the viewer 102 within the virtual 3D display.
  • the navigation system 106 is further configured to receive one or more inputs from the viewer 102.
  • the navigation system 106 is also configured to capture a plurality of images of the place such that a 360 degree view of the place is covered for generating the plurality of scanned images of the place.
  • the navigation system 106 is further configured to store a plurality of virtual 3D displays of a plurality of places, a plurality of scanned images of the place, and a plurality of links associated with the plurality of virtual 3D displays.
  • the links may comprise a uniform resource locator.
  • the navigation system 106 is configured to store and maintain users’login credential information, history of the viewer 102, interest of the viewer 102, details about one or more products/services, information of the plurality of exhibition/place, virtual 3D display, navigation information, the plurality of scanned images, one or more activities of the viewer 102 while viewing the virtual 3D display.
  • the database is located on a remote device comprising the server 108.
  • the 3D scanned displays, 3D scanned images, login credentials of the viewer 102 may be saved or stored either locally on the computing device 104 or on a database or storage device of the server 108.
  • the server 108 may be a remotely located computation and storage device.
  • the one or more activities of the viewer may comprise a time spent at a particular position by the viewer, current interest of the viewer in a product/service, gestures of the viewer, and so forth.
  • the navigation system 106 is also configured to retrieve the plurality of 3D scanned images of the place.
  • the navigation system 106 is also configured to generate a two-dimensional live stream of the place.
  • the navigation system 106 is also configured to superimpose the two-dimensional live streaming of the place with the plurality of 3D scanned images for generating a three-dimensional live streaming of the place.
  • the navigation system 106 is also configured to present the 3D live streaming of the place along with one or more navigation options to the viewer 102.
  • the one or more navigation options may guide the viewer 102 within the 3D live stream of the place. Further, the viewer 102 may select at least one of the one or more navigation options.
  • the navigation options comprises an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place.
  • the 3D live streaming along with the one or more navigation options may be generated and presented to the viewer 102 in real-time.
  • the 3D live streaming is presented to the viewer 102 via at least one of a web based system, an augmented reality device and a virtual reality device.
  • the navigation options may be presented as one or more arrows.
  • the viewer may select a “moving left option” of the one or more navigation options for viewing a left side of the place with respect to a current position of the viewer 102 within the 3D live streaming.
  • FIG. 2 illustrates a block diagram depicting various system elements of an exemplary navigation system 202, in accordance with various embodiments of the present disclosure.
  • the navigation system 202 comprises an access managing module 204, a display managing module 206, one or more scanners 208, a database 210, a superimposing module 212, and a navigation module 214.
  • a user such as the viewer 102 of FIG. 1, accesses the navigation system 202 via a web browser on a computing device such as, a smart phone.
  • the viewer 102 may view a virtual 3D view comprising a 3D live streaming of a place, such as an exhibition, in real-time when the exhibition is actually happening.
  • the viewer 102 may view the virtual 3D view of the exhibition at a later time may be after the exhibition has finished.
  • the viewer 102 may view the place/exhibition anytime and from anywhere by using a smart phone comprising the navigation system 202.
  • the access managing module 204 may be configured to authorize an identity of the viewer 102 based on a valid login credential.
  • the login credential may include, but are not limited to, a password, a login identifier (ID) , a name, a location, and so forth.
  • Post authorization the viewer 102 may gain access to one or more features of the navigation system 202.
  • the scanners 208 are configured to capture one or more 3D scanned images covering a 360-degree view of the place for generating a plurality of 3D scanned images of the place.
  • the database 210 may store the plurality of images, and plurality of 3D scanned images of the place.
  • the database 210 is further configured to store a plurality of virtual 3D displays of a plurality of places, and plurality of 3D scanned images of the place.
  • the database 210 is configured to store and maintain a plurality of multimedia comprising advertisement of products/services, navigation information, viewer’login credential information, history of the viewer 102, interest of the viewer 102, details about one or more products/services, information of the plurality of exhibition/place, virtual 3D displays, one or more past activities of the viewer 102 while viewing the virtual 3D display, profile of the viewers, and so forth.
  • the database 210 may be located on a remote device comprising the server 108 as discussed with reference to FIG. 1.
  • the superimposing module 212 is configured to retrieve the plurality of 3D scanned images from the database 210. In some embodiments, the superimposing module 212 is configured to generate two-dimensional (2D) live stream of the place. Further, the superimposing module 212 is configured to superimpose the two-dimensional live stream of the place with the plurality of 3D scanned images of the place for generating a 3D live streaming of the place.
  • the display managing module 206 is configured to present the 3D live streaming of the place along with one or more navigation options to the viewer 102.
  • the one or more navigation options may guide the viewer 102 within the 3D live stream of the place based on one or more activities of the viewer 102.
  • the one or more activities of the viewer comprising a time spent at a particular position by the viewer 102, current interest of the viewer 102 in a product/service, gestures of the viewer 102, and so forth.
  • the viewer 102 may select at least one of the one or more navigation options.
  • the one or more navigation options comprising an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place.
  • the 3D live streaming is generated and presented to the viewer 102 in real-time. In some embodiments, the 3D live streaming is presented to the viewer 102 via at least one of a web based system, an augmented reality device and a virtual reality device.
  • the display managing module 206 is further configured to present a virtual 3D display of the place to the viewer 102 such that the viewer 102 feels as being part of the virtual 3D display.
  • the virtual 3D display may comprise a plurality of scanned images.
  • the display managing module 206 is configured to create the virtual 3D display based on the plurality of scanned images in real-time or non-real time.
  • the virtual 3D display may be a scanned model of the exhibition/place.
  • the viewer 102 may be able to view the virtual 3D display by using at least one of an augmented reality device or a virtual reality device.
  • the navigation module 214 is configured to guide the viewer 102 based on a selection of the at least one of the one or more navigation options received from the viewer 102.
  • FIG. 3 illustrates a flowchart of a method 300 for presenting a 3D live streaming of a place, in accordance with an embodiment of the present disclosure.
  • the navigation system 202 enables the viewer 102 to view an online 3D live streaming of the place and get navigation instruction for navigating the place.
  • a viewer such as the viewer 102
  • the viewer 102 may select a place of which the viewer 102 may want to see a virtual view.
  • the superimposing module 212 retrieves a plurality of pre-stored 3D scanned images from the database 210. Then at step 306, the superimposing module 212 superimposes a two-dimensional live stream of the place with the retrieved plurality of 3D scanned images of the place for generating a 3D live streaming of the place.
  • the display managing module 206 presents the 3D live streaming of the place along with one or more navigation options to the viewer 102.
  • the navigation options may be presented as one or more arrows.
  • the one or more navigation options guides the viewer 102 within the 3D live stream of the place.
  • the navigation options may include an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place.
  • the viewer 102 selects at least one of the one or more navigation options.
  • the viewer 102 views the 3D live streaming of the place by using at least one of a web-based system, an augmented reality (AR) system, and a virtual reality (VR) system.
  • AR augmented reality
  • VR virtual reality
  • a selection of at least one of the one or more navigation options is received from the viewer 102.
  • the navigation module 214 receives the selection of the at least one of the one or more navigation systems from the viewer 102. Thereafter at step 312, the navigation module 214 guides the viewer 102 within the place based on the received selection of the at least one of the one or more navigation options.
  • the present disclosure provides a system for live 3D streaming of an exhibition, which enables the viewer to view the product in the exhibition with more clarity and depth.
  • the products in 3D live streaming looks more realistic.
  • the present disclosure provides a more realistic view of products within the 3D live stream of a place.
  • the products may be at display in the place.
  • the viewer can see exact depth, color, texture, height, length, and other details of the products.
  • the 3D live streaming may be viewed by the viewer by using a web-based display system, a virtual reality system, an augmented reality system, a virtual 3D display system, and the like.
  • the present disclosure provides a system for superimposing already captured scanned images of a place with a 2D stream of the place for generating a 3D live stream of the place.
  • the present disclosure provides navigation options to the viewer in a 3D live streaming of the place.
  • Embodiments of the disclosure are also described above with reference to flowchart illustrations and/or block diagrams of methods and systems. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, may be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the acts specified in the flowchart and/or block diagram block or blocks.
  • These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the acts specified in the flowchart and/or block diagram block or blocks.
  • the computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operations to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the acts specified in the flowchart and/or block diagram block or blocks.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A system for guiding/navigating a viewer in a virtual 3D view of a place, comprising: a database for storing a plurality of three-dimensional (3D) scanned images of the place, wherein the 3D scanned images are captured by scanners to cover a 360 degree view of the place; a superimposing module for superimposing a 2D live stream of the place with the pre-stored 3D scanned images for generating a 3D live streaming of the place; and a display managing module for presenting the 3D live streaming along with navigation options to the viewer, the navigation options guides the viewer within the 3D live stream based activities of the viewer, the viewer selects at least one of the navigation options, the navigation options comprising an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place.

Description

SYSTEMS AND METHOD FOR NAVIGATING A VIEWER WITHIN A LIVE STREAMING OF A PLACE TECHNICAL FIELD
The presently disclosed embodiments relate to the field of three-dimensional (3D) imaging systems. More specifically, embodiments of the present disclosure relate to systems and methods for navigating a viewer while viewing a three-dimensional live streaming of a place.
BACKGROUND
Many exhibitions happen these days about different type of items and arts. For many people, exhibitions are a good way for demonstrating their skills. An exhibition can be a demonstration or public display of works of arts, items of interest that may be held in a museum or an art gallery, or at a trade fair. Usually these exhibitions have a fixed venue and fixed timings. Further, most of the exhibitions have a limit on maximum number of people who can come to see the exhibitions due to many limitations such as a size of the venue, timing, and so forth. Further, people also have their limitations like timing of the exhibition doesn’t suits them, or may be venue for the exhibition is far from their location. Therefore, many people who would want to view the exhibition sometimes are not able to view it due to these limitations. Also when people visit a place or an exhibition physically, then looking at the large number of people in the place, it becomes difficult to understand preference, interest of the people. Currently only two-dimensional live streaming systems exist. But in two-dimensional streaming the details, colour, etc. is not clear.
SUMMARY
In light of above, there exist need for providing techniques for presenting 3D live streaming along with one or more navigation options.
The present disclosure provides a system for navigating a viewer within a three-dimensional (3D) live streaming of a place.
The present disclosure provides a method for navigating a viewer within a three-dimensional (3D) live streaming of a place.
The present disclosure provides a system for navigating a viewer within a three-dimensional (3D) live streaming of a place by presenting the viewer with one or more navigation options.
The present disclosure provides a method for navigating a viewer within a three-dimensional (3D) live streaming of a place by presenting the viewer with one or more navigation options.
The present disclosure provides a system for presenting a three-dimensional live streaming to viewers along with one or more navigation options via a virtual 3D display system. The viewer may view the 3D live streaming of the place by using at least one of a web-based system, a virtual reality system, an augmented reality system and the like.
The present disclosure provides a method presenting a three-dimensional live streaming to viewers along with one or more navigation options via a virtual 3D display system. The viewer may view the 3D live streaming of the place by using at least one of a web-based system, a virtual reality system, an augmented reality system and the like.
The present disclosure provides a method for superimposing a two-dimensional live streaming with a plurality of 3D scanned images for generating 3D live streaming. The 3D live streaming is presented to the viewer along with one or more navigation options for guiding the viewer within the 3D live stream of the place. The viewer may select at least one of the navigation options.
he present disclosure provides a method for superimposing a two-dimensional live streaming with a plurality of 3D scanned images for generating 3D live streaming. The 3D live streaming is presented to the viewer along with one or more navigation options for guiding the viewer within the 3D live stream of the place. The viewer may select at least one of the navigation options.
The present disclosure provides a method for enabling a viewer to view a 3D live streaming of a place by using a virtual 3D system, an augmented reality system, a virtual reality system, and a web-based display system.
The present disclosure provides a system for enabling a viewer to view a 3D live streaming of a place by using a virtual 3D system, an augmented reality system, a virtual reality system, and a web-based display system.
The present disclosure provides a navigation system for presenting a 3D live streaming of the place along with one or more navigation options to a viewer. The navigation options may comprise a option for moving right, moving left, moving forward, moving backward, viewing a 360-degree view of the place, and so forth. The viewer may select at least one of the navigation options. Further, the navigation options may be presented as one or more arrows within the 3D live streaming.
The present disclosure provides a navigation method for presenting a 3D live streaming of the place along with one or more navigation options to a viewer. The navigation options may comprise a option for moving right, moving left, moving forward, moving backward, viewing a 360-degree view of the place, and so forth. The viewer may select at least one of the navigation options. Further, the navigation options may be presented as one or more arrows within the 3D live streaming
An embodiment of the present disclosure provides a live streaming system for navigating a viewer, comprising: a database configured to store a plurality of three-dimensional (3D) scanned images of a place, wherein the plurality of 3D scanned images are captured by a plurality of scanners to cover a 360 degree view of the place; a superimposing module configured to: retrieve the plurality of pre-stored 3D scanned images of the place from the database; and generate a 3D live streaming of the place by superimposing a two-dimensional live stream of the place with the plurality of pre-stored 3D scanned images; and a display managing module configured to present the 3D live streaming along with one or more navigation options to the viewer, the one or more navigation options guides the viewer within the 3D live stream of the place, the viewer selects at least one of the one or more navigation options.
According to an aspect of the present disclosure, the 3D live streaming along with the navigation options is generated and presented to the viewer in real-time.
According to another aspect of the present disclosure, the plurality of 3D scanned images are pre-captured and pre-stored in the database.
According to another aspect of the present disclosure, the viewer based on a valid login credential for viewing the 3D live streaming of the place
According to another aspect of the present disclosure, the 3D live streaming is presented to the viewer via at least one of a web based system, a virtual 3D display system, an augmented reality device, /system and a virtual reality device/system.
According to other aspect of the present disclosure, the database is further configured to store and maintain users’login credential information, pre-stored 3D scanned images, history of the viewer, interest of the viewer, navigation information, details about one or more products/services, information of the plurality of exhibition/place, virtual 3D display, the plurality of scanned images, one or more past activities of the viewer while viewing the virtual 3D display.
According to another aspect of the present disclosure, the database is located on a remote device comprising a server.
According to another aspect of the present disclosure, the three-dimensional live streaming and/or the virtual display of the place is presented to the viewer via at least one of a web based system, an augmented reality device and a virtual reality device.
According to another aspect of the present disclosure, the viewer views the virtual 3D display of the place via a web browser.
According to another aspect of the present disclosure, the virtual 3D display is presented to the viewer in real-time.
According to another aspect of the present disclosure, the navigation system 106 is also configured to generate a two-dimensional live stream of the place.
According to an aspect of the present disclosure, the virtual 3D display is viewed in non-real time.
According to an aspect of the present disclosure, the plurality of 3D scanned images are stored in a database located on a remote device comprising a server.
According to an aspect of the present disclosure, the navigation options comprises an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place.
Another embodiment of the present disclosure provides a navigation system for guiding a viewer in a virtual 3D view of a place, comprising: a database configured to store a plurality of three-dimensional (3D) scanned images of the place, wherein the plurality of 3D scanned images are captured by a plurality of scanners to cover a 360 degree view of the place; a superimposing module configured to superimpose a two-dimensional live stream of the place with the plurality of pre-stored 3D scanned images for generating a 3D live streaming of the place; a display managing module configured to present the 3D live streaming along with one or more navigation options to a viewer, the one or more navigation options guides the viewer within the 3D live stream of the place based on one or more activities of the viewer, the viewer selects at least one of the one or more navigation options, further wherein the one or more navigation options comprising an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place and a navigation module for guiding the viewer within the 3D live stream of the place based on a selection of the at least one of the one or more navigation options received from the viewer.
According to an aspect of the present disclosure, the one or more activities of the viewer comprising a time spent at a particular position by the viewer, current interest of the viewer in a product/service, gestures of the viewer, and so forth.
According to an aspect of the present disclosure, the 3D live streaming is viewed by the viewer via a web based system, an augmented reality device, a virtual reality device, and the like.
Another embodiment of the present disclosure provides a method for navigating a viewer, comprising: storing a plurality of three-dimensional (3D) scanned images of the place in a database, wherein the plurality of 3D scanned images are captured by a plurality of scanners to cover a 360 degree view of the place; retrieving the plurality of pre-stored 3D scanned images of the place from the database; generating a 3D live streaming of the place by superimposing a two-dimensional live stream of the place with the plurality of pre-stored 3D scanned images; and presenting the 3D live streaming along with one or more navigation  options to the viewer, the one or more navigation options guides the viewer within the 3D live stream of the place, the viewer selects at least one of the one or more navigation options.
In some embodiments of the present disclosure, the method comprises capturing the plurality of 3D images of the place for covering a 360-degree view of the place.
According to an aspect of the present disclosure, the viewer is authorized based on a valid login credential for viewing the 3D live streaming of the place.
According to an aspect of the present disclosure, the place can be an exhibition comprising display of a number of products and services.
A yet another embodiment of the present disclosure provides a navigation method for guiding a viewer in a virtual 3D view of a place, comprising: storing a plurality of three-dimensional (3D) scanned images of the place, wherein the plurality of 3D scanned images are captured by a plurality of scanners to cover a 360 degree view of the place; superimposing a two-dimensional live stream of the place with the plurality of pre-stored 3D scanned images for generating a 3D live streaming of the place; presenting the 3D live streaming along with one or more navigation options to a viewer, the one or more navigation options guides the viewer within the 3D live stream of the place based on one or more activities of the viewer, the viewer selects at least one of the one or more navigation options, further wherein the one or more navigation options comprising an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place; and guiding the viewer within the 3D live stream of the place based on a selection of the at least one of the one or more navigation options received from the viewer.
BRIEF DESCRIPTION OF THE DRAWINGS
Non-limiting and non-exhaustive embodiments of the present invention are described with reference to the following drawings. In the drawings, like reference numerals refer to like parts throughout the various figures unless otherwise specified.
For a better understanding of the present invention, reference will be made to the following Detailed Description, which is to be read in association with the accompanying drawings, wherein:
FIG. 1 illustrates an exemplary environment where various embodiments of the present disclosure may function;
FIG. 2 illustrates a block diagram depicting various system elements of an exemplary live streaming system, in accordance with various embodiments of the present disclosure; and
FIG. 3 illustrates a flowchart of a method for guiding a viewer in a three-dimensional (3D) live stream of a place, in accordance with an embodiment of the present disclosure.
The headings used herein are for organizational purposes only and are not meant to be used to limit the scope of the description or the claims. As used throughout this application, the word “may” is used in a permissive sense (i.e., meaning having the potential to) , rather than the mandatory sense (i.e., meaning must) . To facilitate understanding, like reference numerals have been used, where possible, to designate like elements common to the figures.
DETAILED DESCRIPTION
The presently disclosed subject matter is described with specificity to meet statutory requirements. However, the description itself is not intended to limit the scope of this patent. Rather, the inventors have contemplated that the claimed subject matter might also be embodied in other ways, to include different steps or elements similar to the ones described in this document, in conjunction with other present or future technologies. Moreover, although the term “step” may be used herein to connote different aspects of methods employed, the term should not be interpreted as implying any particular order among or between various steps herein disclosed unless and except when the order of individual steps is explicitly described.
Reference throughout this specification to “a select embodiment” , “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosed subject matter. Thus, appearances of the phrases “a select embodiment” “in one embodiment” or “in an embodiment” in various places throughout this specification are not necessarily referring to the same embodiment.
Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided, to provide a thorough understanding of embodiments of the disclosed subject matter. One skilled in the relevant art will recognize, however, that the disclosed subject matter can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring aspects of the disclosed subject matter.
All numeric values are herein assumed to be modified by the term “about, ” whether or not explicitly indicated. The term “about” generally refers to a range of numbers that one of skill in the art would consider equivalent to the recited value (i.e., having the same or substantially the same function or result) . In many instances, the terms “about” may include numbers that are rounded to the nearest significant figure. The recitation of numerical ranges by endpoints includes all numbers within that range (e.g., 1 to 5 includes 1, 1.5, 2, 2.75, 3, 3.80, 4, and 5) .
As used in this specification and the appended claims, the singular forms “a, ” “an, ” and “the” include or otherwise refer to singular as well as plural referents, unless the content  clearly dictates otherwise. As used in this specification and the appended claims, the term “or” is generally employed to include “and/or, ” unless the content clearly dictates otherwise.
The following detailed description should be read with reference to the drawings, in which similar elements in different drawings are identified with the same reference numbers. The drawings, which are not necessarily to scale, depict illustrative embodiments and are not intended to limit the scope of the disclosure.
FIG. 1 illustrates an exemplary environment 100 where various embodiments of the present disclosure may function. As shown, the environment 100 primarily includes a viewer 102, a computing device 104 comprising a navigation system 106, and a server 108. The viewer 102 may register with the navigation system 106 by entering one or more personal details such as a name, an age, a location, a gender, and so forth on an interface of the computing device 104. The viewer 102 can be any user with authorized login credentials for accessing virtual view of a place such as, but not limited to, an exhibition by using the navigation system 106 and at least one of an augmented reality device/system, a web based system, or/and a virtual reality device/system. In an exemplary scenario, the navigation system 106 may allow the viewer 102 to view a virtual 3D live stream and/or a virtual 3D display of a place such as, an exhibition on the computing device 104 by entering the valid login credentials from anywhere and at anytime. Further, the viewer 102 may not be required to physically visit the exhibition for viewing it. The viewer 102 may be presented with a three-dimensional (3D) live streaming and/or three-dimensional (3D) virtual display including a virtual view of the exhibition/place by the navigation system 106 such that the viewer 102 may feel as being part of the exhibition/place and virtually may feel the environment of the exhibition or the place. The examples of the exhibition may include a painting exhibition, a museum exhibition, a product exhibition, a service exhibition, and so forth. Further, an exhibition may be a display of products or services in an indoor area such as a hall, or in an outdoor area such as a ground.
In some embodiments, the navigation system 106 may be an application installed on the computing device 104. In alternative embodiments, the viewer 102 may access the navigation system 106 via a website URL on a web browser such as, but not limited to, Google Chrome, Internet Explorer, and so forth on the computing device 104. In some embodiments, the navigation system 106 may be a single device or combination or multiple device or modules or systems capable of analyzing data generated during such as, a session of the viewer 102 while viewing the virtual 3D view and/or a three-dimensional (3D) live streaming of the place/exhibition. Further, the navigation system 106 may be software, hardware, firmware, and combination of these. In some embodiments, the computing device 104 may be such as, but not limited to, a smart phone, a tablet computer, a television, a laptop, a smart watch, a smart TV, a computer, and so forth.
The navigation system 106 is configured to authorize the viewer 102 based on a valid login credentials. Further, the navigation system 106 is configured to present a 3D live streaming of a place to the viewer 102 such that the viewer 102 feels as being part of the  virtual 3D display. In some embodiments, the navigation system 106 is configured to present a virtual 3D view or display of the place to the viewer 102 such that the viewer 102 feels as being part of the virtual 3D display. The viewer 102 can feel one or more products for display in the virtual 3D display/3D live streaming of the place. The virtual 3D display may comprise a plurality of scanned images of the place captured by one or more scanners. In some embodiments, the virtual 3D display is presented to the viewer 102 via at least one of a web based system, an augmented reality device and a virtual reality device/system. further, the viewer 102 may view the 3D live stream by using a virtual 3D display system, a virtual reality system, a web-based display system, an augmented reality system, and the like.
The navigation system 106 is further configured to sense a movement, behavior, one or more activities of the viewer 102, a current interest of the viewer in a product/service in the first virtual 3D display, and/or one or more gestures of the viewer 102 within the virtual 3D display. The navigation system 106 is further configured to receive one or more inputs from the viewer 102.
In some embodiments, the navigation system 106 is also configured to capture a plurality of images of the place such that a 360 degree view of the place is covered for generating the plurality of scanned images of the place.
The navigation system 106 is further configured to store a plurality of virtual 3D displays of a plurality of places, a plurality of scanned images of the place, and a plurality of links associated with the plurality of virtual 3D displays. The links may comprise a uniform resource locator. In further embodiments, the navigation system 106 is configured to store and maintain users’login credential information, history of the viewer 102, interest of the viewer 102, details about one or more products/services, information of the plurality of exhibition/place, virtual 3D display, navigation information, the plurality of scanned images, one or more activities of the viewer 102 while viewing the virtual 3D display. In some embodiments, the database is located on a remote device comprising the server 108. The 3D scanned displays, 3D scanned images, login credentials of the viewer 102 may be saved or stored either locally on the computing device 104 or on a database or storage device of the server 108. The server 108 may be a remotely located computation and storage device. The one or more activities of the viewer may comprise a time spent at a particular position by the viewer, current interest of the viewer in a product/service, gestures of the viewer, and so forth.
The navigation system 106 is also configured to retrieve the plurality of 3D scanned images of the place. The navigation system 106 is also configured to generate a two-dimensional live stream of the place. The navigation system 106 is also configured to superimpose the two-dimensional live streaming of the place with the plurality of 3D scanned images for generating a three-dimensional live streaming of the place.
The navigation system 106 is also configured to present the 3D live streaming of the place along with one or more navigation options to the viewer 102. The one or more navigation options may guide the viewer 102 within the 3D live stream of the place. Further, the viewer 102 may select at least one of the one or more navigation options. The navigation  options comprises an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place. The 3D live streaming along with the one or more navigation options may be generated and presented to the viewer 102 in real-time. In some embodiments, the 3D live streaming is presented to the viewer 102 via at least one of a web based system, an augmented reality device and a virtual reality device. The navigation options may be presented as one or more arrows.
For example, the viewer may select a “moving left option” of the one or more navigation options for viewing a left side of the place with respect to a current position of the viewer 102 within the 3D live streaming.
FIG. 2 illustrates a block diagram depicting various system elements of an exemplary navigation system 202, in accordance with various embodiments of the present disclosure. As shown, the navigation system 202 comprises an access managing module 204, a display managing module 206, one or more scanners 208, a database 210, a superimposing module 212, and a navigation module 214. In some embodiments, a user, such as the viewer 102 of FIG. 1, accesses the navigation system 202 via a web browser on a computing device such as, a smart phone. The viewer 102 may view a virtual 3D view comprising a 3D live streaming of a place, such as an exhibition, in real-time when the exhibition is actually happening. In some embodiments, the viewer 102 may view the virtual 3D view of the exhibition at a later time may be after the exhibition has finished. The viewer 102 may view the place/exhibition anytime and from anywhere by using a smart phone comprising the navigation system 202.
The access managing module 204 may be configured to authorize an identity of the viewer 102 based on a valid login credential. The login credential may include, but are not limited to, a password, a login identifier (ID) , a name, a location, and so forth. Post authorization, the viewer 102 may gain access to one or more features of the navigation system 202.
The scanners 208 are configured to capture one or more 3D scanned images covering a 360-degree view of the place for generating a plurality of 3D scanned images of the place. The database 210 may store the plurality of images, and plurality of 3D scanned images of the place. The database 210 is further configured to store a plurality of virtual 3D displays of a plurality of places, and plurality of 3D scanned images of the place. In some embodiments, the database 210 is configured to store and maintain a plurality of multimedia comprising advertisement of products/services, navigation information, viewer’login credential information, history of the viewer 102, interest of the viewer 102, details about one or more products/services, information of the plurality of exhibition/place, virtual 3D displays, one or more past activities of the viewer 102 while viewing the virtual 3D display, profile of the viewers, and so forth. In some embodiments, the database 210 may be located on a remote device comprising the server 108 as discussed with reference to FIG. 1.
The superimposing module 212 is configured to retrieve the plurality of 3D scanned images from the database 210. In some embodiments, the superimposing module 212 is configured to generate two-dimensional (2D) live stream of the place. Further, the  superimposing module 212 is configured to superimpose the two-dimensional live stream of the place with the plurality of 3D scanned images of the place for generating a 3D live streaming of the place.
The display managing module 206 is configured to present the 3D live streaming of the place along with one or more navigation options to the viewer 102. The one or more navigation options may guide the viewer 102 within the 3D live stream of the place based on one or more activities of the viewer 102. The one or more activities of the viewer comprising a time spent at a particular position by the viewer 102, current interest of the viewer 102 in a product/service, gestures of the viewer 102, and so forth. Further, the viewer 102 may select at least one of the one or more navigation options. The one or more navigation options comprising an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place. In some embodiments, the 3D live streaming is generated and presented to the viewer 102 in real-time. In some embodiments, the 3D live streaming is presented to the viewer 102 via at least one of a web based system, an augmented reality device and a virtual reality device.
In some embodiments, the display managing module 206 is further configured to present a virtual 3D display of the place to the viewer 102 such that the viewer 102 feels as being part of the virtual 3D display. The virtual 3D display may comprise a plurality of scanned images. In some embodiments, the display managing module 206 is configured to create the virtual 3D display based on the plurality of scanned images in real-time or non-real time. The virtual 3D display may be a scanned model of the exhibition/place. Further, the viewer 102 may be able to view the virtual 3D display by using at least one of an augmented reality device or a virtual reality device.
The navigation module 214 is configured to guide the viewer 102 based on a selection of the at least one of the one or more navigation options received from the viewer 102.
FIG. 3 illustrates a flowchart of a method 300 for presenting a 3D live streaming of a place, in accordance with an embodiment of the present disclosure. As discussed with respect to FIG. 2, the navigation system 202 enables the viewer 102 to view an online 3D live streaming of the place and get navigation instruction for navigating the place.
The method initiates at step 302, a viewer, such as the viewer 102, may be authorized by the access managing module 204 of the navigation system 202 based on a valid login credential. The viewer 102 may select a place of which the viewer 102 may want to see a virtual view.
Then at step 304, the superimposing module 212 retrieves a plurality of pre-stored 3D scanned images from the database 210. Then at step 306, the superimposing module 212 superimposes a two-dimensional live stream of the place with the retrieved plurality of 3D scanned images of the place for generating a 3D live streaming of the place.
At step 308, the display managing module 206 presents the 3D live streaming of the place along with one or more navigation options to the viewer 102. The navigation options may be presented as one or more arrows. The one or more navigation options guides the viewer 102 within the 3D live stream of the place. The navigation options may include an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place. Further, the viewer 102 selects at least one of the one or more navigation options. In some embodiments, the viewer 102 views the 3D live streaming of the place by using at least one of a web-based system, an augmented reality (AR) system, and a virtual reality (VR) system.
At step 310, a selection of at least one of the one or more navigation options is received from the viewer 102. In some embodiments, the navigation module 214 receives the selection of the at least one of the one or more navigation systems from the viewer 102. Thereafter at step 312, the navigation module 214 guides the viewer 102 within the place based on the received selection of the at least one of the one or more navigation options.
The present disclosure provides a system for live 3D streaming of an exhibition, which enables the viewer to view the product in the exhibition with more clarity and depth. The products in 3D live streaming looks more realistic.
The present disclosure provides a more realistic view of products within the 3D live stream of a place. The products may be at display in the place. The viewer can see exact depth, color, texture, height, length, and other details of the products. The 3D live streaming may be viewed by the viewer by using a web-based display system, a virtual reality system, an augmented reality system, a virtual 3D display system, and the like.
The present disclosure provides a system for superimposing already captured scanned images of a place with a 2D stream of the place for generating a 3D live stream of the place.
The present disclosure provides navigation options to the viewer in a 3D live streaming of the place.
Embodiments of the disclosure are also described above with reference to flowchart illustrations and/or block diagrams of methods and systems. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, may be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the acts specified in the flowchart and/or block diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the acts specified in the  flowchart and/or block diagram block or blocks. The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operations to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the acts specified in the flowchart and/or block diagram block or blocks.
In addition, methods and functions described herein are not limited to any particular sequence, and the acts or blocks relating thereto can be performed in other sequences that are appropriate. For example, described acts or blocks may be performed in an order other than that specifically disclosed, or multiple acts or blocks may be combined in a single act or block.
While the invention has been described in connection with what is presently considered to be the most practical and various embodiments, it is to be understood that the invention is not to be limited to the disclosed embodiments, but on the contrary, is intended to cover various modifications and equivalent arrangements.

Claims (18)

  1. A live streaming system for navigating a viewer, comprising:
    a database configured to store a plurality of three-dimensional (3D) scanned images of a place, wherein the plurality of 3D scanned images are captured by a plurality of scanners to cover a 360 degree view of the place;
    a superimposing module configured to:
    retrieve the plurality of pre-stored 3D scanned images of the place from the database; and
    generate a 3D live streaming of the place by superimposing a two-dimensional live stream of the place with the plurality of pre-stored 3D scanned images; and
    a display managing module configured to present the 3D live streaming along with one or more navigation options to the viewer, the one or more navigation options guides the viewer within the 3D live stream of the place, the viewer selects at least one of the one or more navigation options.
  2. The system of claim 1 further comprising an access managing module configured to authorize the viewer based on a valid login credential for viewing the 3D live streaming of the place.
  3. The system of claim 1, wherein the 3D live streaming along with the one or more navigation options is generated and presented to the viewer in real-time.
  4. The system of claim 1, wherein the database is further configured to store and maintain viewers’ login credential information, 3D live streaming of a plurality of places, the plurality of 3D scanned images of the places, history of the viewer, interest of the viewer, details about one or more products/services, navigation information, information of the plurality of exhibition/place, virtual 3D display, navigation information, the plurality of scanned images, one or more past activities of the viewer while viewing the virtual 3D display.
  5. The system of claim 1, wherein the database is located on a remote device comprising a server.
  6. The system of claim 1, wherein the 3D live streaming is presented to the viewer via at least one of a web based system, an augmented reality device and a virtual reality device.
  7. The system of claim 1, wherein the navigation options comprises an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place.
  8. A navigation system for guiding a viewer in a virtual 3D view of a place, comprising:
    a database configured to store a plurality of three-dimensional (3D) scanned images of the place, wherein the plurality of 3D scanned images are captured by a plurality of scanners to cover a 360 degree view of the place;
    a superimposing module configured to superimpose a two-dimensional live stream of the place with the plurality of pre-stored 3D scanned images for generating a 3D live streaming of the place;
    a display managing module configured to present the 3D live streaming along with one or more navigation options to a viewer, the one or more navigation options guides the viewer within the 3D live stream of the place based on one or more activities of the viewer, the viewer selects at least one of the one or more navigation options, further wherein the one or more navigation options comprising an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place; and
    a navigation module configured to guide the viewer based on a selection of the at least one of the one or more navigation options received from the viewer.
  9. The system of claim 8, wherein the one or more activities of the viewer comprising a time spent at a particular position by the viewer, current interest of the viewer in a product/service, gestures of the viewer, and so forth.
  10. A method for navigating a viewer, comprising:
    storing a plurality of three-dimensional (3D) scanned images of the place in a database, wherein the plurality of 3D scanned images are captured by a plurality of scanners to cover a 360 degree view of the place;
    retrieving the plurality of pre-stored 3D scanned images of the place from the database;
    generating a 3D live streaming of the place by superimposing a two-dimensional live stream of the place with the plurality of pre-stored 3D scanned images; and
    presenting the 3D live streaming along with one or more navigation options to the viewer, the one or more navigation options guides the viewer within the 3D live stream of the place, the viewer selects at least one of the one or more navigation options.
  11. The method of claim 10 further comprising presenting the 3D live streaming long with the one or more navigation options to the viewer in real-time.
  12. The method of claim 10 further comprising presenting a virtual 3D display of the place to the viewer such that the viewer feels as being part of the first virtual 3D display.
  13. The method of claim 10 further comprising authorizing the viewer based on a valid login credential for viewing the 3D live streaming of the place.
  14. The method of claim 10 further comprising storing and maintaining viewers’ login credential information, 3D live streaming of a plurality of places, the plurality of 3D scanned images of the places, history of the viewer, interest of the viewer, details about one or more products/services, information of the plurality of exhibition/place, virtual 3D display, navigation information, the plurality of scanned images, one or more past activities of the viewer while viewing the virtual 3D display.
  15. The method of claim 10, wherein the 3D live streaming is presented to the viewer via at least one of a web based system, an augmented reality device and a virtual reality device.
  16. The method of claim 10, wherein the navigation options comprises an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place.
  17. A navigation method for guiding a viewer in a virtual 3D view of a place, comprising:
    storing a plurality of three-dimensional (3D) scanned images of the place, wherein the plurality of 3D scanned images are captured by a plurality of scanners to cover a 360 degree view of the place;
    superimposing a two-dimensional live stream of the place with the plurality of pre-stored 3D scanned images for generating a 3D live streaming of the place;
    presenting the 3D live streaming along with one or more navigation options to a viewer, the one or more navigation options guides the viewer within the 3D live stream of the place based on one or more activities of the viewer, the viewer selects at least one of the one or more navigation options, further wherein the one or more navigation options comprising an option for moving left, moving right, moving forward, moving backward, and taking a 360-degree view of the place; and
    guiding the viewer within the 3D live steam of the place based on a selection of the at least one of the one or more navigation options received from the viewer.
  18. The method of claim 17, wherein the one or more activities of the viewer comprising a time spent at a particular position by the viewer, current interest of the viewer in a product/service, gestures of the viewer, and so forth.
PCT/CN2018/091426 2017-12-27 2018-06-15 Systems and method for navigating a viewer within a live streaming of a place Ceased WO2019128139A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201762610548P 2017-12-27 2017-12-27
US62/610,548 2017-12-27

Publications (1)

Publication Number Publication Date
WO2019128139A1 true WO2019128139A1 (en) 2019-07-04

Family

ID=63007468

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/091426 Ceased WO2019128139A1 (en) 2017-12-27 2018-06-15 Systems and method for navigating a viewer within a live streaming of a place

Country Status (2)

Country Link
CN (1) CN108364353A (en)
WO (1) WO2019128139A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109195020B (en) * 2018-10-11 2021-07-02 三星电子(中国)研发中心 An AR-enhanced game live broadcast method and system
CN111541907B (en) * 2020-04-23 2023-09-22 腾讯科技(深圳)有限公司 Article display method, apparatus, device and storage medium
CN111935494A (en) * 2020-08-13 2020-11-13 上海识装信息科技有限公司 3D commodity live display method and system
CN118433434A (en) * 2024-05-29 2024-08-02 江苏医博云科技有限公司 Immersive live broadcast system guiding service robot and application method thereof

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104253862A (en) * 2014-09-12 2014-12-31 北京诺亚星云科技有限责任公司 Digital panorama-based immersive interaction browsing guide support service system and equipment
CN105931288A (en) * 2016-04-12 2016-09-07 广州凡拓数字创意科技股份有限公司 Construction method and system of digital exhibition hall
US20160321841A1 (en) * 2015-04-28 2016-11-03 Jonathan Christen Producing and consuming metadata within multi-dimensional data
CN106530408A (en) * 2016-12-27 2017-03-22 苏州和云观博数字科技有限公司 Museum temporary exhibition planning and design system
CN106803283A (en) * 2016-12-29 2017-06-06 东莞新吉凯氏测量技术有限公司 Interactive three-dimensional panoramic multimedia virtual exhibition method based on physical exhibition hall
CN107018336A (en) * 2017-04-11 2017-08-04 腾讯科技(深圳)有限公司 The method and apparatus of image procossing and the method and apparatus of Video processing

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6335765B1 (en) * 1999-11-08 2002-01-01 Weather Central, Inc. Virtual presentation system and method
US20120256917A1 (en) * 2010-06-25 2012-10-11 Lieberman Stevan H Augmented Reality System
CN102708138B (en) * 2012-03-12 2016-01-13 上海创图网络科技发展有限公司 Virtual museum system and collection methods of exhibiting thereof
US20140164988A1 (en) * 2012-12-06 2014-06-12 Microsoft Corporation Immersive view navigation
CN104199874B (en) * 2014-08-20 2018-07-31 哈尔滨工程大学 A kind of webpage recommending method based on user browsing behavior
US10547825B2 (en) * 2014-09-22 2020-01-28 Samsung Electronics Company, Ltd. Transmission of three-dimensional video
CN105868303A (en) * 2016-03-27 2016-08-17 北京图文天地文化艺术有限公司 A virtual 3D scene internet terminal exhibition system and a using method thereof
CN106200900B (en) * 2016-06-24 2019-02-01 北京奇思信息技术有限公司 Trigger the method and system of virtual reality interaction in video based on identification region
CN106373148A (en) * 2016-08-31 2017-02-01 中国科学院遥感与数字地球研究所 Equipment and method for realizing registration and fusion of multipath video images to three-dimensional digital earth system
CN106383576B (en) * 2016-09-08 2019-06-14 北京美吉克科技发展有限公司 The method and system of experiencer's body part are shown in VR environment
CN106648083B (en) * 2016-12-09 2019-12-31 广州华多网络科技有限公司 Enhanced playing scene synthesis control method and device
CN106774910A (en) * 2016-12-24 2017-05-31 深圳市虚拟现实技术有限公司 Streetscape implementation method and device based on virtual reality
CN106951093A (en) * 2017-03-31 2017-07-14 联想(北京)有限公司 A kind of data processing method and device
CN107103645B (en) * 2017-04-27 2018-07-20 腾讯科技(深圳)有限公司 virtual reality media file generation method and device
CN107179830B (en) * 2017-05-25 2020-06-02 广东智慧电子信息产业股份有限公司 Information processing method for motion sensing application, mobile terminal and storage medium
CN107291244A (en) * 2017-07-04 2017-10-24 宁波美象信息科技有限公司 A kind of VR visits system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104253862A (en) * 2014-09-12 2014-12-31 北京诺亚星云科技有限责任公司 Digital panorama-based immersive interaction browsing guide support service system and equipment
US20160321841A1 (en) * 2015-04-28 2016-11-03 Jonathan Christen Producing and consuming metadata within multi-dimensional data
CN105931288A (en) * 2016-04-12 2016-09-07 广州凡拓数字创意科技股份有限公司 Construction method and system of digital exhibition hall
CN106530408A (en) * 2016-12-27 2017-03-22 苏州和云观博数字科技有限公司 Museum temporary exhibition planning and design system
CN106803283A (en) * 2016-12-29 2017-06-06 东莞新吉凯氏测量技术有限公司 Interactive three-dimensional panoramic multimedia virtual exhibition method based on physical exhibition hall
CN107018336A (en) * 2017-04-11 2017-08-04 腾讯科技(深圳)有限公司 The method and apparatus of image procossing and the method and apparatus of Video processing

Also Published As

Publication number Publication date
CN108364353A (en) 2018-08-03

Similar Documents

Publication Publication Date Title
WO2019128137A1 (en) Online three-dimensional editing systems and methods
WO2019128138A1 (en) Three-dimensional live streaming systems and methods
US10157504B1 (en) Visual display systems and method for manipulating images of a real scene using augmented reality
US11003912B2 (en) Systems and methods for personalized augmented reality view
US9460351B2 (en) Image processing apparatus and method using smart glass
US20180121988A1 (en) Product recommendations based on augmented reality viewpoints
TWI617930B (en) Method and system for sorting a search result with space objects, and a computer-readable storage device
US20170085964A1 (en) Interactive Object Placement in Virtual Reality Videos
WO2019128139A1 (en) Systems and method for navigating a viewer within a live streaming of a place
US20240298068A1 (en) Method and apparatus for synthesized video stream
WO2019119746A1 (en) Systems and methods for suggesting product/service within a virtual 3d display
WO2019105001A1 (en) Immersive display systems and methods
CN107870962A (en) Method and system for remotely managing local space objects
US11568615B2 (en) Collaborative on-demand experiences
WO2019105003A1 (en) Data analysis systems and methods
WO2019119745A1 (en) Systems and methods for suggesting routes within a virtual 3d display
WO2019119744A1 (en) Systems and methods for presenting a plan to a user
WO2019134348A1 (en) Artificial intelligence based display systems and methods
CA3035773A1 (en) Systems and methods for augmented reality view
US20210150815A1 (en) Method and apparatus for creating augmented reality content
WO2019128134A1 (en) Virtual 3d immersive display systems and methods
WO2019105002A1 (en) Systems and methods for creating virtual 3d environment
WO2019128136A1 (en) Virtual three-dimensional immersive display systems and methods
WO2019128135A1 (en) Virtual three-dimensional immersive display systems and methods
WO2019105004A1 (en) Information managing systems and methods

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18897748

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18897748

Country of ref document: EP

Kind code of ref document: A1