US 11,797,632 B2
Image reranking and presentation for visual exploration
Nikita Astrakhantsev, Bellevue, WA (US); Parthasarathy Govindarajen, Sammamish, WA (US); Nektarios Ioannides, Seattle, WA (US); Arun Sacheti, Sammamish, WA (US); Alexander Jack Sunell, Seattle, WA (US); Avinash Vemuluru, Sammamish, WA (US); Xiaodong Fan, Bellevue, WA (US); Dong Han Wang, Bellev, WA (US); Alexandra Victoria Foote, Bellevue, WA (US); Jun Liu, Bellevue, WA (US); Elena Usinskiene, Seattle, WA (US); Diane Ash Shambaugh, Redmond, WA (US); Qianyue You, Renton, WA (US); Liang Tang, Bothell, WA (US); Souvick Sarkar, Redmond, WA (US); Jeffrey Roger Devries, Seattle, WA (US); and Adam Jeffrey Curtis, Seattle, WA (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on Mar. 1, 2021, as Appl. No. 17/188,941.
Prior Publication US 2022/0277056 A1, Sep. 1, 2022
Int. Cl. G06F 16/9538 (2019.01); G06F 40/14 (2020.01); G06F 16/538 (2019.01); G06T 11/60 (2006.01); G06F 40/106 (2020.01)
CPC G06F 16/9538 (2019.01) [G06F 16/538 (2019.01); G06F 40/106 (2020.01); G06F 40/14 (2020.01); G06T 11/60 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for presenting structured data with search engine results on a display of a device, comprising:
receiving a query from a user, wherein the query identifies a multi-step task and comprises a request for task details for completing the task;
providing the query to a search engine;
responsive to providing the query, receiving results from the search engine, wherein the received results include identification of a plurality of webpages, wherein each webpage of the plurality of webpages includes details to complete the task;
presenting on the display a search result webpage responsive to receiving the results, the search result webpage including a plurality of images from the plurality of webpages, wherein the plurality of images are presented in a cascading waterfall layout that includes a plurality of columns by placing one image of the plurality of images into each column of the plurality of columns and continuing to place images into each column based on an available number of pixels in a column until a predetermined number of images are displayed in the cascading waterfall layout;
receiving a user selection of an image from the plurality of images; and
responsive to the user selection:
presenting, adjacent to the plurality of images on the search result webpage, structured data corresponding to the image, the structured data comprising details from the webpage to complete the task; and
adjusting the presentation of the cascading waterfall layout based on the selection of the image, wherein the adjusting includes at least one of: resizing a column of the plurality of columns, and rearranging an ordering of images within at least one column of the plurality of columns.