AMENDED CLAIMS received by the International Bureau on 17 March 2018 (17.03.2018) What is claimed is:
1. A method comprising:
at an electronic device with a display, wherein the electronic device is associated with a first user:
receiving a first message from a second user, wherein the first message includes first content;
receiving first status data for the second user, wherein the first status data is:
associated with the first message,
based on a first biometric characteristic of the second user detected at the time the second user composed and/or sent the first message, and
separate from the first content;
displaying concurrently, on the display, the first message, including the first content, and a first avatar, wherein the first avatar is based on the first status data and the displayed first avatar is adjacent to the displayed first message;
after displaying the first message and the first avatar, receiving a second message from the second user, wherein the second message includes second content;
receiving second status data for the second user, wherein the second status is associated with the second message and separate from the second content; and
while maintaining the display of the first message and the first avatar, displaying, on the display, the second message, including the second content, and a second avatar, wherein the displayed second avatar is adjacent to the displayed second message, the second avatar is based on the second status data, and the first avatar and the second avatar are different.
2. The method of claim 1, further comprising:
displaying contact information for a set of users that includes contact information for the second user, wherein the second avatar is displayed with the contact information for the second user.
3. The method of any of claims 1 or 2 further comprising:
receiving a first avatar model for the second user;
generating the first avatar based on the first avatar model and first status data; and generating the second avatar based on the first avatar model and the second status data.
4. The method of any of claims 1 or 2 further comprising:
receiving a second avatar model for the second user;
generating an updated first avatar based on the second avatar model and first status data; generating an updated second avatar based on the second avatar model and the second status data; and
displaying the updated first avatar instead of the first avatar with the first message including the first content.
5. (Cancelled)
6. The method of any of claims 1 or 2 further comprising:
selecting one or more characteristics for the first avatar based on the first status data.
7. The method of any of claims 1 or 2 further comprising:
selecting one or more characteristics for the second avatar based on the second status data, wherein the second status data is based on a second biometric characteristic.
8. The method of any of claims 1 or 2, wherein the first avatar is an animated avatar.
9. The method of any of claims 1 or 2, wherein the first status data is based on an optical image or a depth image of the second user.
10. The method of any of claims 1 or 2, further comprising:
mapping the first status data on to a predefined avatar model to create the first avatar.
11. The method of any of claims 1 or 2, wherein the first status data represents an emotion of the second user.
12. (Cancelled)
13. The method of any of claims 1 or 2, wherein the second status data is based on a detected expression of the second user at the time the second user composed and/or sent the second message.
14. The method of any of claims 1 or 2, further comprising:
receiving, from the first user and on the electronic device, third content for a third message; generating third status data for the first user;
associating the third status data with the third message;
sending the third message to the second user; and
sending the third status data to the second user.
15. The method of claim 13 further comprising:
concurrently displaying the third message including the third content and a third avatar, wherein the third avatar is based on the third status data, and the third message and third avatar are displayed concurrently with the second message and second avatar.
16. The method of any of claims 1 or 2, wherein the first avatar and second avatar represent the physical appearance of the second user.
17. The method of any of claims 1 or 2, wherein displaying the first message and the first avatar includes displaying the first message as a text bubble coming from a mouth of the first avatar.
18. The method of any of claims 1 or 2, wherein the second user is associated with a source electronic device that sends the first message and the second message.
19. An electronic device, comprising:
a display;
one or more processors;
one or more input devices;
a memory; and
one or more programs, wherein the one or more programs are stored in memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
receiving a first message from a second user, wherein the first message includes first content;
receiving first status data for the second user, wherein the first status data is: associated with the first message,
based on a first biometric characteristic of the second user detected at the time the second user composed and/or sent the first message, and
separate from the first content;
displaying concurrently, on the display, the first message, including the first content, and a first avatar, wherein the first avatar is based on the first status data and the displayed first avatar is adjacent to the displayed first message;
after displaying the first message and the first avatar, receiving a second message from the second user, wherein the second message includes second content;
receiving second status data for the second user, wherein the second status is associated with the second message and separate from the second content; and
while maintaining the display of the first message and the first avatar, displaying, on the display, the second message, including the second content, and a second avatar, wherein the displayed second avatar is adjacent to the displayed second message, the second avatar is based on the second status data, and the first avatar and the second avatar are different.
20. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device with a display and one or more input devices, cause the device to:
receive a first message from a second user, wherein the first message includes first content;
receive first status data for the second user, wherein the first status data is^
associated with the first message,
based on a first biometric characteristic of the second user detected at the time the second user composed and/or sent the first message, and
separate from the first content;
display concurrently, on the display, the first message, including the first content, and a first avatar, wherein the first avatar is based on the first status data and the displayed first avatar is adjacent to the displayed first message;
after displaying the first message and the first avatar, receive a second message from the second user, wherein the second message includes second content;
receive second status data for the second user, wherein the second status is associated with the second message and separate from the second content; and
while maintaining the display of the first message and the first avatar, display, on the display, the second message, including the second content, and a second avatar, wherein the displayed second avatar is adjacent to the displayed second message, the second avatar is based on the second status data, and the first avatar and the second avatar are different.
21. An electronic device, comprising:
a display;
one or more input devices;
means for receiving a first message from a second user, wherein the first message includes first content;
means for receiving first status data for the second user, wherein the first status data is: associated with the first message,
based on a first biometric characteristic of the second user detected at the time the second user composed and/or sent the first message, and
separate from the first content;
means for displaying concurrently, on the display, the first message, including the first content, and a first avatar, wherein the first avatar is based on the first status data and the displayed first avatar is adjacent to the displayed first message;
means for receiving a second message from the second user, after displaying the first message and the first avatar, wherein the second message includes second content;
means for receiving second status data for the second user, wherein the second status is associated with the second message and separate from the second content; and
means for displaying, while maintaining the display of the first message and the first avatar, on the display, the second message, including the second content, and a second avatar, wherein the displayed second avatar is adjacent to the displayed second message, the second avatar is based on the second status data, and the first avatar and the second avatar are different.
22. An electronic device, comprising:
a display;
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods of claims 1-4, 6-11, and 13-18.
23. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device with a display and one or more input devices, cause the device to perform any of the methods of claims 1-4, 6-11, and 13-18.
24. An electronic device, comprising:
a display;
means for performing any of the methods of claims 1-4, 6-11, and 13-18.
25. A method, comprising:
at an electronic device with one or more image sensors, memory, and a display:
capturing first image data from one or more image sensors of the electronic device, wherein the first image data includes first optical image data of an object from a first perspective;
capturing second image data from the one or more image sensors of the electronic device, wherein the second image data includes second optical image light data of the object from a second perspective that is different from the first perspective;
selecting an algorithm based on the change in perspective from the first perspective to the second perspective;
based on the algorithm, determining additional image data that is needed to continue the 3D modeling of the object; and
displaying, on the display, visual feedback that provides instructions for capturing the additional image data determined based on the selected algorithm.
26. The method of claim 25 further comprising:
receiving third data, wherein the third data includes third optical image data of the object from a third perspective;
selecting an updated algorithm based on the third perspective, wherein the updated algorithm is different than the algorithm;
based on the updated algorithm, determining updated additional image data that is needed to continue the 3D modeling of the object, wherein the updated additional image data is different than the additional image data; and
displaying, on the display, visual feedback that provides updated instructions for capturing the updated additional image data, wherein the update instructions are different than the instructions displayed prior to selecting the update algorithm.
27. The method of claim 26 further comprising:
building a 3D model of the object based on the first image data, the second image data, the third image data, and the updated additional image data using the selected updated algorithm.
28. The method of any of claims 26 or 27 further comprising:
sending at least a portion of the first image data to a remote server; and
receiving an indication from the remote server that the third data is available for the object.
29. The method of one of claims 25-27, wherein displaying, on the display, visual feedback that provides updated instructions for capturing the updated additional image data includes: in accordance with a determination that a first algorithm has been selected, displaying a first set of instructions; and
in accordance with a determination that a second algorithm, different from the first algorithm, has been selected, the visual feedback includes a second set of instructions different than the first set of instructions.
30. The method of any of claims 25-27, wherein the first image data includes first depth image data of the object from the first perspective.
31. The method of any of claims 25-27, further comprising:
obtaining first position data for the first perspective.
32. The method of claim 31 , wherein selecting the algorithm is also based on the first position data.
33. The method of any of claims 25-27further comprising:
capturing second position data for the second perspective, wherein the second image data includes second depth image data of the object from the second perspective and selecting the algorithm is also based on the second position data.
34. The method of any of claims 25-27, further comprising:
building a 3D model of the object based on the first image data, the second image data, and the additional image data using the selected algorithm; and
storing, in the memory, the 3D model.
35. The method of any of claims 25-27, wherein selecting the algorithm includes selecting a scan-based algorithm based on the change from the first perspective to the second perspective indicating that the first image data and the second image data are from a scan of the object.
36. The method of any of claims 25-27, wherein selecting the algorithm includes selecting a discrete-image -based algorithm based on the change from the first perspective to the second perspective indicating that the first perspective and the second perspective are for discrete images.
37. The method of any of claims 25-27, further comprising:
identifying a support in the first image data that is touching the object; and
building a 3D model of the object based on the first image data and the second image data using the selected algorithm, wherein the 3D model does not include the support touching the first object.
38. The method of any of claims 25-27, further comprising:
displaying on a display of the electronic device a first window that includes a live image of the object; and
displaying on the display a second window that includes an image of a model of the object, wherein the model is based on the first image data and the second image data.
39. An electronic device, comprising:
a display;
one or more processors;
one or more input devices;
a memory; and
one or more programs, wherein the one or more programs are stored in memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
capturing first image data from one or more image sensors of the electronic device, wherein the first image data includes first optical image data of an object from a first perspective;
capturing second image data from the one or more image sensors of the electronic device, wherein the second image data includes second optical image light data of the object from a second perspective that is different from the first perspective;
selecting an algorithm based on the change in perspective from the first perspective to the second perspective;
based on the algorithm, determining additional image data that is needed to continue the 3D modeling of the object; and
130
displaying, on the display, visual feedback that provides instructions for capturing the additional image data determined based on the selected algorithm.
40. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device with a display and one or more input devices, cause the device to:
capture first image data from one or more image sensors of the electronic device, wherein the first image data includes first optical image data of an object from a first perspective;
capture second image data from the one or more image sensors of the electronic device, wherein the second image data includes second optical image light data of the object from a second perspective that is different from the first perspective;
select an algorithm based on the change in perspective from the first perspective to the second perspective;
based on the algorithm, determine additional image data that is needed to continue the 3D modeling of the object; and
display, on the display, visual feedback that provides instructions for capturing the additional image data determined based on the selected algorithm.
41. An electronic device, comprising:
a display;
one or more input devices;
means for capturing first image data from one or more image sensors of the electronic device, wherein the first image data includes first optical image data of an object from a first perspective; means for capturing second image data from the one or more image sensors of the electronic device, wherein the second image data includes second optical image light data of the object from a second perspective that is different from the first perspective;
means for selecting an algorithm based on the change in perspective from the first perspective to the second perspective;
means for, based on the algorithm, determining additional image data that is needed to continue the 3D modeling of the object; and
131
means for displaying, on the display, visual feedback that provides instructions for capturing the additional image data determined based on the selected algorithm.
42. An electronic device, comprising:
a display;
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods of claims 25-38.
43. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device with a display and one or more input devices, cause the device to perform any of the methods of claims 25-38.
44. An electronic device, comprising:
a display;
means for performing any of the methods of claims 25-38.
45. A method comprising:
at an electronic device with a display and one or more image sensors;
displaying, on the display, content in an application, wherein the content is displayed while the application is in a first configuration;
while displaying the content, capturing image data ( from the one or more image sensors of the electronic device;
after capturing the image data, receiving a request to navigate away from the content; and in response to receiving a request to navigate away from the content:
in accordance with a determination that a first set of content-lock criteria have been met, preventing navigation away from the content while maintaining display of the content, wherein
the first set of content-lock criteria includes a first criterion that is met when the captured image data indicates that an unauthorized user is using the device; and
in accordance with a determination that the first set of content-lock criteria have not been met, navigating away from the content in accordance with the request.
46. The method of claim 45 further comprising:
in accordance with a determination that the first set of content-lock criteria is no longer met, allowing navigation away from the content.
47. The method of any of claims 45 or 46, wherein the first set of lock-criteria includes a second criterion that is met when the captured image data indicates that an authorized user of the electronic device is not using the device.
48. The method of any of claims 45 or 46, wherein the first set of lock-criteria includes a third criterion that is met when the captured image data indicates that the unauthorized user is present and an authorized user is not present.
49. The method of any of claims 45 or 46, wherein the first set of lock-criteria is met when the captured image data indicates that the unauthorized user is present without regard to whether or not an authorized user is present.
50. The method of any of claims 45 or 46, further comprising:
in accordance with a determination that a second set of content-lock criteria has been met, disabling at least one function of the electronic device.
51. The method of claim 50, wherein the first set of lock-criteria and the second set of lock- criteria are different.
52. The method of any of claims 45 or 46, further comprising:
in accordance with a determination that a third set of content- lock criteria has been met, switching the application to a second configuration that limits operation of the application as compared to the first configuration.
53. The method of any of claims 45 or 46, further comprising:
in accordance with the determination that a fourth set of content-lock criteria have been met, locking other functionality of the electronic device while continuing to display the content in the application.
54. The method of any of claims 45 or 46, further comprising:
in accordance with the determination that a fifth set of content- lock criteria have been met, preventing the display of a notification related to a communication received at the electronic device.
55. The method of claim 54, wherein:
the fifth set of lock-criteria includes a fourth criterion that is met when the captured image data indicates that an unauthorized user is using the electronic device and the fifth set of lock-criteria is met if the fourth criterion is met; and
the first set of lock-criteria includes a fifth criteria that is met when the captured image data indicates the absence of an authorized user.
56. The method of claim 55 further comprising:
in accordance with the fourth criterion being met, preventing navigation between applications on the electronic device; and
in accordance with the fifth criterion being met, preventing navigation within the application.
57. The method of any of claims 45 or 46, further comprising:
determining whether the captured image data indicates the presence of an unauthorized user of the electronic device.
134
58. The method of any of claims 45 or 46, wherein the image data includes optical data and depth data, and wherein determining whether the first set of content-lock criteria have been met is based on the optical data and the depth data.
59. The method of any of claims 45 or 46, wherein navigating away from the content includes translating currently displayed content.
60. The method of any of claims 45 or 46, wherein navigating away from the content includes switching between content items in an application.
61. The method of any of claims 45 or 46, wherein navigating away from the content includes switching applications or closing the application to display the home screen.
62. The method of any of claims 45 or 46, further comprising:
receiving unlock information associated with an authorized user of the electronic device;
determining whether the unlock information is authentic; and
in accordance with a determination that the unlock information is authentic, enabling navigation away from the content.
63. An electronic device, comprising:
a display;
one or more processors;
one or more input devices;
a memory; and
one or more programs, wherein the one or more programs are stored in memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, on the display, content in an application, wherein the content is displayed while the application is in a first configuration;
while displaying the content, capturing image data ( from the one or more image sensors of the electronic device;
135
after capturing the image data, receiving a request to navigate away from the content; and in response to receiving a request to navigate away from the content:
in accordance with a determination that a first set of content-lock criteria have been met, preventing navigation away from the content while maintaining display of the content, wherein the first set of content-lock criteria includes a first criterion that is met when the captured image data indicates that an unauthorized user is using the device; and
in accordance with a determination that the first set of content-lock criteria have not been met, navigating away from the content in accordance with the request.
64. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device with a display and one or more input devices, cause the device to:
display, on the display, content in an application, wherein the content is displayed while the application is in a first configuration;
while displaying the content, capture image data ( from the one or more image sensors of the electronic device;
after capturing the image data, receive a request to navigate away from the content; and in response to receiving a request to navigate away from the content:
in accordance with a determination that a first set of content-lock criteria have been met, prevent navigation away from the content while maintaining display of the content, wherein the first set of content-lock criteria includes a first criterion that is met when the captured image data indicates that an unauthorized user is using the device; and
in accordance with a determination that the first set of content-lock criteria have not been met, navigate away from the content in accordance with the request.
65. An electronic device, comprising:
a display;
one or more input devices;
means for displaying, on the display, content in an application, wherein the content is displayed while the application is in a first configuration;
136
while displaying the content, means for capturing image data ( from the one or more image sensors of the electronic device;
means for, after capturing the image data, receiving a request to navigate away from the content; and
in response to receiving a request to navigate away from the content:
means for, in accordance with a determination that a first set of content-lock criteria have been met, preventing navigation away from the content while maintaining display of the content, wherein the first set of content-lock criteria includes a first criterion that is met when the captured image data indicates that an unauthorized user is using the device; and
means for, in accordance with a determination that the first set of content-lock criteria have not been met, navigating away from the content in accordance with the request.
66. An electronic device, comprising:
a display;
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods of claims 45-62.
67. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device with a display and one or more input devices, cause the device to perform any of the methods of claims 45-62.
68. An electronic device, comprising:
a display;
means for performing any of the methods of claims 45-62.
137