US 12,411,542 B2
Electronic devices using object recognition and/or voice recognition to provide personal and health assistance to users
Kenneth Luke Kocienda, Mill Valley, CA (US); Yanir Nulman, San Francisco, CA (US); Lilynaz Hashemi, San Francisco, CA (US); Imran A Chaudhri, San Francisco, CA (US); Jane Koo, San Francisco, CA (US); Adam Binsz, San Francisco, CA (US); Eugene Bistolas, Mountain View, CA (US); George Kedenburg, San Francisco, CA (US); and Jenna Arnost, Kamas, UT (US)
Assigned to Hewlett-Packard Development Company, L.P., Spring, TX (US)
Filed by Hewlett-Packard Development Company, L.P., Spring, TX (US)
Filed on Mar. 15, 2024, as Appl. No. 18/607,296.
Claims priority of provisional application 63/496,677, filed on Apr. 17, 2023.
Claims priority of provisional application 63/454,937, filed on Mar. 27, 2023.
Claims priority of provisional application 63/453,333, filed on Mar. 20, 2023.
Claims priority of provisional application 63/453,045, filed on Mar. 17, 2023.
Prior Publication US 2024/0310900 A1, Sep. 19, 2024
Int. Cl. G06F 3/01 (2006.01); G06F 3/16 (2006.01); G06V 10/82 (2022.01); G06V 20/50 (2022.01); G06V 20/68 (2022.01); G09G 3/00 (2006.01)
CPC G06F 3/011 (2013.01) [G06F 3/167 (2013.01); G06V 10/82 (2022.01); G06V 20/50 (2022.01); G06V 20/68 (2022.01); G09G 3/001 (2013.01); G09G 2354/00 (2013.01)] 26 Claims
OG exemplary drawing
 
1. A method comprising:
accessing, by a wearable multimedia device worn by a user, image data regarding an environment of the user, wherein the image data is generated using one or more image sensors of the wearable multimedia device;
determining, by the wearable multimedia device based on the image data, an item of interest in the environment of the user;
receiving, by the wearable multimedia device, a first user input from the user, wherein the first user input comprises a first command with respect to the item of interest, wherein the first user input is received using one or more microphones of the wearable multimedia device, and wherein the first command comprises a request for feedback regarding the item of interest;
performing, by the wearable multimedia device using one or more of machine learning models, the first command with respect to the item of interest, wherein performing the first command comprises generating first output data using the one or more machine learning models, and wherein generating the first output data comprises retrieving and aggregating product review information regarding the item of interest;
receiving, by the wearable multimedia device, a second user input from the user, wherein the second user input comprises a second command with respect to the item of interest, wherein the second user input is received using the one or more microphones of the wearable multimedia device, and wherein the second command comprises a request for information regarding the item of interest;
performing, by the wearable multimedia device using the one or more of machine learning models, the second command with respect to the item of interest, wherein performing the second command comprises generating second output data using the one or more machine learning models, and wherein the second output data comprises at least one of:
an identity of the item of interest, or
at least one of a make or a model of the item of interest; and
presenting, by the wearable multimedia device, at least a portion of the first output data and at least a portion of the second output data to the user.