ESDS Update November 2021#

November was an active month! There were a couple of ESDS Forum talks, a variety of answered Python questions during office hours, and a Python tutorial!

Check out the following ESDS update for the month of November 2021.

Xdev Updates#

Xdev has continued to make progress on the Funnel project; this extends the data catalog with “analysis recipes”, providing an effective strategy for modularization and extensibility of workflows.

The esds-funnel provides the caching framework, while the esm-collections repository is where we prototype the full workflows with the catalogs and analysis recipes.

We have continued to push forward on the xwrf project, which aims to help bring the Weather Research and Forecasting (WRF) model into the Pangeo ecosystem. Be sure to follow the xwrf repository for updates.

ESDS Forum#

Python Package Overviews#

General Discussion#

ESDS Blog Posts#

Data Computation#

End to End Workflow#

Office Hour Questions#

During the month of October 2021, our team answered a total of 10 questions at our weekly Xdev Office Hours.

Below is a summary of the most common questions brought up during office hours!


Matplotlib Questions#

  • How do you make boxplots with two datasets of varying sizes?

    • Solution: Called plt.boxplot() twice, use width = 0.1 for both calls and positions=[1.5,2.5,3.5,4.5] for the second call.

Dask Questions#

  • How do you run Dask on Casper?

    • Solution: Encouraged use of ncar-jobqueue package, using the compute nodes on Casper.

Xarray Questions#

  • How do you load multiple files into xarray and plot the output?

  • How do you drop specific dates from a dataset?

    • Solution: Used cftime_range() along with sel_drop()

Conda Questions#

Python Tutorial(s)#

Object Oriented Programming Tutorial#