Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CESM2 CAM6 present day PPE Monthly Average (LWCF and SWCF) #116

Open
yiqioyang opened this issue May 6, 2024 · 1 comment
Open

CESM2 CAM6 present day PPE Monthly Average (LWCF and SWCF) #116

yiqioyang opened this issue May 6, 2024 · 1 comment
Labels

Comments

@yiqioyang
Copy link

Dataset Name

CESM2 CAM6 present day PPE Monthly Average (LWCF and SWCF)

Dataset URL

https://www.earthsystemgrid.org/dataset/ucar.cgd.cesm2.cam6.ppe.pd_timeseries.atm.hist.monthly_ave.LWCF/file.html and https://www.earthsystemgrid.org/dataset/ucar.cgd.cesm2.cam6.ppe.pd_timeseries.atm.hist.monthly_ave.SWCF/file.html

Description

I want to download two sets of nc files.
They can be found at:
https://www.earthsystemgrid.org/dataset/ucar.cgd.cesm2.cam6.ppe.pd_timeseries.atm.hist.monthly_ave.LWCF/file.html https://www.earthsystemgrid.org/dataset/ucar.cgd.cesm2.cam6.ppe.pd_timeseries.atm.hist.monthly_ave.SWCF/file.html;

Within each link, I hope to download all 262 files. The downloading python script can be accessed by the "Download Options for Selection" within the link, after all files are selected.

Size

2 * 262 * 7.61 MB

License

Unknown

Data Format

NetCDF

Data Format (other)

No response

Access protocol

HTTP(S)

Source File Organization

Each nc file corresponds to one variable (LWCF or SWCF) from one simulation. Each nc file has the dimension of time and space (lat and lon).

Example URLs

https://tds.ucar.edu/thredds/fileServer/datazone/campaign/cgd/projects/ppe/cam_ppe/rerun_PPE_250/PD/PD_timeseries/PPE_250_ensemble_PD.000/atm/hist/cc_PPE_250_ensemble_PD.000.h0.SWCF.nc?api-token=TGLy7EMWBpimnosAbrfUyvvlyAHRvHUjzrna0Mqz

Authorization

No; data are fully public

Transformation / Processing

The file name has useful information. For example, given the file name "cc_PPE_250_ensemble_PD.000.h0.LWCF.nc", here, the "000" after "PD." is the index (the first in this case) for this run.

If the 262 files were to stacked together, it would be great if such information is kept in the data (e.g., add a new dimension in the xarray object). Otherwise, it is also fine to download them as they are. I have the code to post-process them. Hopefully either way is not too complicated!

Target Format

Zarr

Comments

Please let me know if I wasn't clear or there is any issues downloading the data.

@jbusecke
Copy link
Contributor

jbusecke commented May 9, 2024

Hi @yiqioyang,
thanks for raising this issue. The example URL you provided works for me (which means it is likely going to work for pangeo-forge). Unfortunately I am not able to access the full file list (the top link). But you are the expert on this dataset, so I would suggest we start setting up a feedstock for this dataset.

Could you go to https://github.com/leap-stc/LEAP_template_feedstock and follow the instructions there to build a basic pangeo-forge recipe? Please feel free to tag me on issues there if you should get stuck, and we will go from there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants