Q6: (15 points)In bipartite ranking, documents are grouped i…
Q6: (15 points)In bipartite ranking, documents are grouped into a “relevant (+)” set and a “non-relevant (–)” set. Since relevant documents should appear earlier than non-relevant documents, the ranking error is given by: Total number of disordered pairs/Total number of item pairs between the relevant set and the non-relevant set. Below are a list of documents and their golden-standard relevance labels, the prediction results of a ranking model, and the prediction results of a binary classification model. Please calculate the bipartite ranking error and the binary classification error. Document ID Golden-standard relevance labels The predicted scores of the ranking model The predicted labels of the classification models D1 – 0.91 + D2 – 0.82 + D3 + 0.73 + D4 + 0.64 + D5 + 0.55 + D6 + 0.46 + D7 – 0.37 – D8 – 0.28 –