US 12,316,950 B2
Portable information device having real-time display with relevant information
Hideya Inoue, Yokohama (JP); Toru Iwaoka, Amsterdam (NL); Michiko Noborisaka, Yokohama (JP); Masayuki Hatori, Soka (JP); and Tomohide Hamada, Yokohama (JP)
Assigned to NIKON CORPORATION, Tokyo (JP)
Filed by NIKON CORPORATION, Tokyo (JP)
Filed on Apr. 1, 2024, as Appl. No. 18/623,454.
Application 18/623,454 is a division of application No. 18/127,043, filed on Mar. 28, 2023, granted, now 11,979,654.
Application 18/127,043 is a division of application No. 17/882,052, filed on Aug. 5, 2022, granted, now 11,647,276, issued on May 9, 2023.
Application 17/882,052 is a division of application No. 17/142,722, filed on Jan. 6, 2021, granted, now 11,445,117, issued on Sep. 13, 2022.
Application 17/142,722 is a division of application No. 15/648,777, filed on Jul. 13, 2017, granted, now 10,917,575, issued on Feb. 9, 2021.
Application 15/648,777 is a division of application No. 14/247,737, filed on Apr. 8, 2014, granted, now 9,743,003, issued on Aug. 22, 2017.
Application 14/247,737 is a division of application No. 12/461,324, filed on Aug. 7, 2009, granted, now 8,730,337, issued on May 20, 2014.
Claims priority of provisional application 61/136,294, filed on Aug. 26, 2008.
Claims priority of application No. 2008-205729 (JP), filed on Aug. 8, 2008.
Prior Publication US 2024/0251156 A1, Jul. 25, 2024
Int. Cl. H04N 23/63 (2023.01); H04N 1/00 (2006.01); H04N 1/32 (2006.01); H04N 23/60 (2023.01)
CPC H04N 23/631 (2023.01) [H04N 1/00244 (2013.01); H04N 1/00307 (2013.01); H04N 1/00411 (2013.01); H04N 1/32117 (2013.01); H04N 23/63 (2023.01); H04N 23/633 (2023.01); H04N 23/64 (2023.01); H04N 2201/0084 (2013.01); H04N 2201/3205 (2013.01); H04N 2201/3253 (2013.01); H04N 2201/3273 (2013.01); H04N 2201/3276 (2013.01)] 9 Claims
OG exemplary drawing
 
1. A portable information device configured to be in communication with an information search server via an information communication network, the portable information device comprising:
an image sensor configured to pick up an image of a subject;
a locator configured to acquire position information about an image pickup position of the image sensor;
an orientation sensor configured to acquire an orientation information corresponding to an imaging direction at the image pickup position;
a display configured to display the image of the subject; and
a controller configured to transmit an image information on the subject, the position information and the orientation information to the information search server via the information communication network, wherein
the information search server (a) specifies the subject in the image, based on the image information, the position information and the orientation information, in reference to a database in the information search server, the database storing relevant information on a plurality of objects and position information on the objects, the relevant information being associated, in the database, with at least the position information, the information search server specifying the subject in the image by comparing a characteristic amount from image recognition of the subject in the image with a characteristic amount from image recognition of an image of a selected object of the plurality of objects in the database that is selected based on the position information and the orientation information, and (b) transmits the relevant information on the subject that has been specified to the portable information device via the information communication network, and
the controller controls the display to display the relevant information transmitted by the information search server.