Skip to content

Add COMPASS step for remapping prescribed ISMF#469

Merged
mark-petersen merged 1 commit intoMPAS-Dev:ocean/developfrom
xylar:add_compass_prescribed_land_ice_fluxes
Mar 24, 2020
Merged

Add COMPASS step for remapping prescribed ISMF#469
mark-petersen merged 1 commit intoMPAS-Dev:ocean/developfrom
xylar:add_compass_prescribed_land_ice_fluxes

Conversation

@xylar
Copy link
Collaborator

@xylar xylar commented Mar 9, 2020

The data is from the Rignot et al. (2013) data set (not publicly available).

@xylar
Copy link
Collaborator Author

xylar commented Mar 9, 2020

This work is based off of #468 and should ideally be rebased after that is merged.

@xylar xylar force-pushed the add_compass_prescribed_land_ice_fluxes branch from afbf4df to 5dfdaf5 Compare March 9, 2020 14:57
@mark-petersen
Copy link
Contributor

Please rebase later today or tomorrow.

@xylar
Copy link
Collaborator Author

xylar commented Mar 23, 2020

I think we decided we weren't bothering with this one just yet, right?

@mark-petersen
Copy link
Contributor

Sure. We can put it lower on the list.

@xylar xylar force-pushed the add_compass_prescribed_land_ice_fluxes branch from 8759c4d to 804b06f Compare March 23, 2020 20:10
@xylar
Copy link
Collaborator Author

xylar commented Mar 23, 2020

I went ahead and rebased onto #433 and there were no conflicts.

@xylar xylar removed the in progress label Mar 23, 2020
@mark-petersen
Copy link
Contributor

@xylar could you rebase this again? There were some conflicts on some python import lines that I was unsure of.

The data is from the Rignot et al. (2013) data set (not publicly
available).
@xylar xylar force-pushed the add_compass_prescribed_land_ice_fluxes branch from 804b06f to 5baaf51 Compare March 24, 2020 08:03
@xylar
Copy link
Collaborator Author

xylar commented Mar 24, 2020

I rebased and there was no conflict.

@mark-petersen
Copy link
Contributor

@xylar, can you describe the case, computer, and python package you tested with, and what the directory init/e3sm_coupling/prescribed_ismf contained when you were done?
I tried on grizzly on a compute node using QU240wISC and package compass_0.1.2. I first run the init step. Then I get this:

cd e3sm_coupling/
./run.py
****** prescribed_ismf ******
running: mpirun -np 36 /usr/projects/climate/SHARED_CLIMATE/anaconda_envs/base/envs/compass_0.1.2/bin/ESMF_RegridWeightGen --source /tmp/tmpar9c01qz/src_mesh.nc --destination /tmp/tmpar9c01qz/dst_mesh.nc --weight ./map_5600.0x5600.0km_1.0km_Antarctic_stereo_to_oQU240wISC.nc --method conserve --netcdf4 --no_log --src_regional --dst_regional --ignore_unmapped
Operating system error: Cannot allocate memory
Allocation would exceed memory limit

But this is a brand new functionality. So if it worked for you, I'm happy to merge it and work out the kinks for this grizzly set-up later.

@pwolfram
Copy link
Contributor

@mark-petersen, sometimes a user takes up all the memory on the compute node. I've had this issue before, sure is frustrating.

@mark-petersen
Copy link
Contributor

@pwolfram Are you thinking of a login node? I should be the only one on that compute node. There must be some problem with the size of the files it is loading.

@pwolfram
Copy link
Contributor

Sorry @mark-petersen , I was thinking head node -- I agree that the file might be too big.

@xylar
Copy link
Collaborator Author

xylar commented Mar 24, 2020

@mark-petersen, I believe you are running with the serial version of compass. If that's the case, you will do horrible things if you try to run ESMF_RegridWeightGen with mpirun. It might work but it will just be running 36 independent processes trying to write the same file. You need to set nprocs to 1 until we can get the parallel environment working again (#480). This problem should be with any mapping files you're creating, not just this case, by the way.

Copy link
Contributor

@mark-petersen mark-petersen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved based on visual inspection and @xylar's testing.

@mark-petersen mark-petersen merged commit f5e8ab9 into MPAS-Dev:ocean/develop Mar 24, 2020
@xylar xylar deleted the add_compass_prescribed_land_ice_fluxes branch March 24, 2020 14:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants