Hi @goldpiggy, while going through section 126.96.36.199, I found that it was the mentioned that this case involved covariate shift.
As we explained to them, it would indeed be easy to distinguish between the healthy and sick cohorts with near-perfect accuracy. However, that is because the test subjects differed in age, hormone levels, physical activity, diet, alcohol consumption, and many more factors unrelated to the disease. This was unlikely to be the case with real patients. Due to their sampling procedure, we could expect to encounter extreme covariate shift.
However, as per the definition of Label Shift in 188.8.131.52., it is said that such cases are examples of Label Drift
For example, we may want to predict diagnoses given their symptoms (or other manifestations), even as the relative prevalence of diagnoses are changing over time. Label shift is the appropriate assumption here because diseases cause symptoms
Could you please let me know where am I lacking in understanding here? Thanks
Hi @kusur, great question! In the covariate shift, we focus on the distribution shift of “data” or “feature”. For example, the
in age, hormone levels, physical activity, diet, alcohol consumption, and many more factors ... are all features for a sample point. While for the label shift focus on the distribution shift of the “label”, such as the disease diagnoses. Check more details in this paper: https://arxiv.org/pdf/1802.03916.pdf.