US 12,443,645 B2
Photo content clustering for digital picture frame display and automated frame conversation
Ophir Frieder, Chevy Chase, MD (US); Abdur Chowdhury, San Francisco, CA (US); Eric Jensen, Brooklyn, NY (US); Ben Cherry, San Francisco, CA (US); Richard Sanford, Seattle, WA (US); and Alek Kolcz, Issaquah, WA (US)
Assigned to AURA HOME, INC., San Francisco, CA (US)
Filed by AURA HOME, INC., San Francisco, CA (US)
Filed on Mar. 6, 2023, as Appl. No. 18/117,700.
Application 18/117,700 is a continuation in part of application No. 18/095,118, filed on Jan. 10, 2023, granted, now 11,714,845.
Application 18/095,118 is a continuation of application No. 17/575,097, filed on Jan. 13, 2022, granted, now 11,574,000.
Application 17/575,097 is a continuation of application No. 17/076,494, filed on Oct. 21, 2020, granted, now 11,243,999.
Application 17/076,494 is a continuation of application No. 16/563,511, filed on Sep. 6, 2019, granted, now 10,853,404.
Application 16/563,511 is a continuation of application No. 16/113,366, filed on Aug. 27, 2018, granted, now 10,824,666.
Application 16/113,366 is a continuation in part of application No. 15/824,337, filed on Nov. 28, 2017, granted, now 10,820,293.
Application 15/824,337 is a continuation in part of application No. 15/150,623, filed on May 10, 2016, granted, now 10,474,407.
Application 15/150,623 is a continuation in part of application No. 14/949,353, filed on Nov. 23, 2015, granted, now 9,472,166.
Application 14/949,353 is a continuation in part of application No. 14/455,297, filed on Aug. 8, 2014, granted, now 9,420,015.
Application 14/455,297 is a continuation in part of application No. 14/051,071, filed on Oct. 10, 2013, granted, now 9,225,789.
Application 14/455,297 is a continuation in part of application No. 14/051,089, filed on Oct. 10, 2013, granted, now 9,338,759.
Prior Publication US 2023/0205803 A1, Jun. 29, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 16/435 (2019.01); G06F 16/48 (2019.01); G06F 16/55 (2019.01); G06F 18/23 (2023.01); G06F 18/2323 (2023.01); G06V 10/762 (2022.01); G06V 20/30 (2022.01); G06V 40/16 (2022.01); G06V 40/20 (2022.01); H04N 1/00 (2006.01); H04N 21/2343 (2011.01); H04N 21/454 (2011.01); H04W 4/021 (2018.01); H04W 4/21 (2018.01); H04W 4/80 (2018.01); G01S 5/02 (2010.01); G01S 19/42 (2010.01); G06F 1/16 (2006.01)
CPC G06F 16/435 (2019.01) [G06F 16/48 (2019.01); G06F 16/55 (2019.01); G06F 18/23 (2023.01); G06F 18/2323 (2023.01); G06V 10/7635 (2022.01); G06V 20/30 (2022.01); G06V 40/174 (2022.01); G06V 40/23 (2022.01); H04N 1/00 (2013.01); H04N 1/00185 (2013.01); H04N 21/234372 (2013.01); H04N 21/454 (2013.01); H04W 4/021 (2013.01); H04W 4/21 (2018.02); H04W 4/80 (2018.02); G01S 5/0244 (2020.05); G01S 19/42 (2013.01); G06F 1/1605 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method of displaying photos on a digital picture frame including a digital display mounted within a frame, a microphone and speaker connected to the frame, and a network connection module, the method comprising:
automatically clustering original photos within a digital photo collection into a plurality of sub-clusters, each for a corresponding common detected content in the original photos selected from a person, a thing, a place, an activity, or combinations thereof, wherein each of the plurality of sub-clusters is formed for the corresponding common detected content of interest at a similar time and/or age;
extracting one or more photo features from the corresponding common detected content within the each of the sub-clusters of the original photos to form a cluster representation, wherein the photo features are predetermined as having the limited change over a timeframe;
comparing the cluster representation of the each of the sub-clusters to new photos added to the digital photo collection, to determine a corresponding sub-cluster for each of the new photos;
linking the each of the new photos to the corresponding sub-cluster for display; automatically displaying a slideshow on the digital display of the original photos and the new photos from the digital photo collection as a function of the clustering;
automatically providing a verbal interaction with a viewer of the digital picture frame via the microphone and speaker, wherein the verbal interaction comprises a plurality of automated back-and-forth conversational iterations with the viewer to establish the identity of the user and/or the search parameter, the plurality of automated back-and-forth conversational iterations comprising more than one spoken statement or spoken question from the speaker;
automatically determining a search parameter from the verbal interaction;
automatically connecting to the digital photo collection;
automatically searching the digital photo collection for digital photos matching the search parameter; and
automatically displaying on the digital display matching photos obtained from the digital photo collection over the network connection.