US 12,265,658 B2
Method, device and storage medium for evaluating intelligent human-machine cooperation system
Qichao Zhao, Beijing (CN); and Ran Yang, Beijing (CN)
Assigned to KINGFAR INTERNATIONAL INC., Beijing (CN)
Filed by KINGFAR INTERNATIONAL INC., Beijing (CN)
Filed on Oct. 11, 2023, as Appl. No. 18/378,930.
Application 18/378,930 is a continuation of application No. PCT/CN2023/112288, filed on Aug. 10, 2023.
Claims priority of application No. 202210967645.7 (CN), filed on Aug. 12, 2022.
Prior Publication US 2024/0053826 A1, Feb. 15, 2024
Int. Cl. G06F 3/01 (2006.01)
CPC G06F 3/015 (2013.01) 10 Claims
OG exemplary drawing
 
1. A method for evaluating an intelligent human-machine cooperation system, comprising:
recording objective data of a subject during executing, by the subject, an intelligent human-machine cooperation system test;
inputting the objective data into a pre-trained fitting model for prediction to obtain a predicted subjective evaluation, wherein the pre-trained fitting model is obtained by fitting the objective data and a subjective evaluation, and the subjective evaluation is obtained based on a first subjective evaluation result of the subject after executing the intelligent human-machine cooperation system test for a pre-training; and
generating a real-time objective evaluation based on the objective data of the subject recorded in real-time, and obtaining a real-time human-machine cooperation score by combining the real-time objective evaluation with the predicted subjective evaluation,
wherein the obtaining the real-time human-machine cooperation score by combining the real-time objective evaluation with the predicted subjective evaluation comprises standardizing and summing, according to preset weight values, the real-time objective evaluation and the predicted subjective evaluation.