Should I give treatment to all people whose predict uplift is positive or just the portion which qini curve is ascending? #655
Ramlinbird
started this conversation in
General
Replies: 1 comment
-
With a qini curve, you're checking the quality of your uplift model's rankings against actual uplift values. If your check with actual values shows that the last X% of your population has negative lift, then you probably don't want to target them even if your model predicts positive lift for those observations. Models aren't perfect, so this is a check. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello, I use the causalml's plot_qini function to draw the qini curve of my dataframe, the result is below, (The dataframe contains control/treatment random-ab-test data)
![image](https://private-user-images.githubusercontent.com/11084132/259979845-68ee9984-ee79-422e-a8e6-beef0b79e865.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzg4ODk5MzYsIm5iZiI6MTczODg4OTYzNiwicGF0aCI6Ii8xMTA4NDEzMi8yNTk5Nzk4NDUtNjhlZTk5ODQtZWU3OS00MjJlLWE4ZTYtYmVlZjBiNzllODY1LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMDclMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjA3VDAwNTM1NlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTM4MjM0ZTg1MTkwODE3OWI1NGE2YzFmOTk3ZWRlNjNkYmI4MjcyMWJlMmE1MjdlMzkyMjQ4ODhhY2Y4ZGU5ZmImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.R3jp3unNRz6jX2mIHU8boM8mCweLHE60emVQRFQwNJc)
According to the curve, it seems that only the first 50% users with treatment is useful, and there is negative effect at the last.
But in the original predict uplift with treatment by the model, nearly 90% is larger than 0.
Should I chose the 90% or 30% to give the treatment? Thanks a lot.
Beta Was this translation helpful? Give feedback.
All reactions