Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Estimation of HTE evolving across single/two covariates #1467

Open
Tauhmax opened this issue Oct 29, 2024 · 2 comments
Open

Estimation of HTE evolving across single/two covariates #1467

Tauhmax opened this issue Oct 29, 2024 · 2 comments
Labels

Comments

@Tauhmax
Copy link

Tauhmax commented Oct 29, 2024

Hi team,

Thank you very much for the nice work! In HTE analysis, typically papers would show how the effect evolve across one/two variables, for the ease to interpret and get insights. For example, given a list of covariates (Age, Gender, Income, ...), we would like to see how a policy affect the health condition differently across these characteristics. And usually we want to check one by one, holding the other covariates constant. I also see a lot papers plot such graph.

c4b2290dc20cd508fcc11c49a1f49b1

image

Possible solution 1

As I learn from this package, we can use average_treatment_effect function, specifying the subset parameter. Taking age as an example, we can Iteratively feed subgroup with data$Age==18 / data$Age==19 / data$Age==20, ... then collect the output for each subgroup and visualize it. Am I correct on this point?

Possible solution 2

Also, I was wondering if I can use predict to query the effect on each sample, then group these effect based on Age to estimate the CATE for each age. The mean and confidence interval could be derived by aggregating the effect of each sample.

Possible solution 3

Finally, I guess I can use predict(X.test) by manipulating X.test as the characteristics of each group (e.g., Age=18/19/20) and set other column with constant mean/median?

I searched issues and some papers but do not get confirmation on implementation details. Hope to get your comments and suggestions. Thanks!

Best

@erikcs
Copy link
Member

erikcs commented Nov 14, 2024

Hi @Tauhmax, you are right that there are many approaches you can take to construct visualizations like these. One approach that is popular in practice is to create partial dependence plots by predicting on some chosen X.test, like you hinted at in 3), an example of this is here: https://bookdown.org/stanfordgsbsilab/ml-ci-tutorial/hte-i-binary-treatment.html#partial-dependence

@Tauhmax
Copy link
Author

Tauhmax commented Nov 14, 2024

Hi @Tauhmax, you are right that there are many approaches you can take to construct visualizations like these. One approach that is popular in practice is to create partial dependence plots by predicting on some chosen X.test, like you hinted at in 3), an example of this is here: https://bookdown.org/stanfordgsbsilab/ml-ci-tutorial/hte-i-binary-treatment.html#partial-dependence

Thank you @erikcs very much! It is very helpful to have this guidance. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants