US 11,861,061 B2
Virtual sharing of physical notebook
Orit Dolev, Tel Aviv (IL); Tomer Kahan, Ramat Hasharon (IL); Tamir Berliner, Tel Aviv (IL); and Tomer Dvir, Tel Aviv (IL)
Assigned to SIGHTFUL COMPUTERS LTD, Tel Aviv (IL)
Filed by MULTINARITY LTD, Tel Aviv (IL)
Filed on Dec. 30, 2022, as Appl. No. 18/091,434.
Application 18/091,434 is a continuation of application No. PCT/US2022/038450, filed on Jul. 27, 2022.
Claims priority of provisional application 63/344,727, filed on May 23, 2022.
Claims priority of provisional application 63/319,423, filed on Mar. 14, 2022.
Claims priority of provisional application 63/307,217, filed on Feb. 7, 2022.
Claims priority of provisional application 63/307,207, filed on Feb. 7, 2022.
Claims priority of provisional application 63/307,203, filed on Feb. 7, 2022.
Claims priority of provisional application 63/299,188, filed on Jan. 13, 2022.
Claims priority of provisional application 63/226,180, filed on Jul. 28, 2021.
Prior Publication US 2023/0145049 A1, May 11, 2023
Int. Cl. G10L 15/22 (2006.01); G06T 11/60 (2006.01); G06T 7/70 (2017.01); G06V 40/20 (2022.01); G06T 19/20 (2011.01); G06V 40/10 (2022.01); G08B 7/00 (2006.01); G06F 3/01 (2006.01); G06V 20/20 (2022.01); G06F 3/023 (2006.01); G06F 3/16 (2006.01); G09G 3/00 (2006.01); G06T 19/00 (2011.01); G06T 7/73 (2017.01); G06F 40/169 (2020.01); G06F 3/14 (2006.01); G02B 27/01 (2006.01); G06F 1/16 (2006.01); G06V 10/74 (2022.01)
CPC G06F 3/012 (2013.01) [G02B 27/0172 (2013.01); G06F 1/163 (2013.01); G06F 3/011 (2013.01); G06F 3/017 (2013.01); G06F 3/0231 (2013.01); G06F 3/1423 (2013.01); G06F 3/1454 (2013.01); G06F 3/167 (2013.01); G06F 40/169 (2020.01); G06T 7/70 (2017.01); G06T 7/73 (2017.01); G06T 11/60 (2013.01); G06T 19/00 (2013.01); G06T 19/006 (2013.01); G06T 19/20 (2013.01); G06V 10/761 (2022.01); G06V 20/20 (2022.01); G06V 40/28 (2022.01); G09G 3/001 (2013.01); G10L 15/22 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0143 (2013.01); G02B 2027/0178 (2013.01); G06T 2219/2004 (2013.01); G06V 40/10 (2022.01); G06V 40/20 (2022.01); G08B 7/00 (2013.01); G09G 2320/064 (2013.01); G09G 2320/0613 (2013.01); G09G 2320/0686 (2013.01); G09G 2330/021 (2013.01); G09G 2354/00 (2013.01); G10L 2015/223 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A non-transitory computer readable medium containing instructions for causing at least one processor to perform operations to enable collaboration between physical writers and virtual writers, the operations comprising:
receiving image data representing a hand of a first physical writer holding a physical marking implement and engaging with a physical surface to create tangible markings, wherein the image data is received from an image sensor associated with a wearable extended reality appliance worn by the first physical writer;
transmitting information based on the image data to at least one computing device associated with at least one second virtual writer, to thereby enable the at least one second virtual writer to view the tangible markings created by the first physical writer;
receiving from the at least one computing device annotation data representing additional markings in relative locations with respect to the tangible markings created by the first physical writer; and
in response to receiving the annotation data, causing the wearable extended reality appliance to overlay the physical surface with virtual markings in the relative locations;
wherein the physical surface is a compilation of pages;
wherein the received annotation data represents first virtual markings associated with a first page of the compilation and second virtual markings associated with a second page of the compilation; and
wherein the compilation is a notebook, and the operations further include analyzing the image data to determine that the notebook is opened to the first page, and causing the wearable extended reality appliance to overlay the first virtual markings on the first page of the notebook and exclude overlaying the second virtual markings on the first page of the notebook.