dedalus.tools.post

Post-processing helpers.

Module Contents

logger
visit_writes(set_paths, function, comm=MPI.COMM_WORLD, **kw)

Apply function to writes from a list of analysis sets.

Parameters:
  • set_paths (list of str or pathlib.Path) – List of set paths
  • function (function(set_path, start, count, **kw)) – A function on an HDF5 file, start index, and count.
  • comm (mpi4py.MPI.Intracomm, optional) – MPI communicator (default: COMM_WORLD)
  • Other keyword arguments are passed on to `function`

Notes

This function is parallelized over writes, and so can be effectively parallelized up to the number of writes from all specified sets.

get_assigned_writes(set_paths, comm=MPI.COMM_WORLD)

Divide writes from a list of analysis sets between MPI processes.

Parameters:
  • set_paths (list of str or pathlib.Path) – List of set paths
  • comm (mpi4py.MPI.Intracomm, optional) – MPI communicator (default: COMM_WORLD)
get_all_writes(set_paths)

Get write numbers from a list of analysis sets.

Parameters:set_paths (list of str or pathlib.Path) – List of set paths
get_assigned_sets(base_path, distributed=False, comm=MPI.COMM_WORLD)

Divide analysis sets from a FileHandler between MPI processes.

Parameters:
  • base_path (str or pathlib.Path) – Base path of FileHandler output
  • distributed (bool, optional) – Divide distributed sets instead of merged sets (default: False)
  • comm (mpi4py.MPI.Intracomm, optional) – MPI communicator (default: COMM_WORLD)
merge_process_files(base_path, cleanup=False, comm=MPI.COMM_WORLD)

Merge process files from all distributed analysis sets in a folder.

Parameters:
  • base_path (str or pathlib.Path) – Base path of FileHandler output
  • cleanup (bool, optional) – Delete distributed files after merging (default: False)
  • comm (mpi4py.MPI.Intracomm, optional) – MPI communicator (default: COMM_WORLD)

Notes

This function is parallelized over sets, and so can be effectively parallelized up to the number of distributed sets.

merge_process_files_single_set(set_path, cleanup=False)

Merge process files from a single distributed analysis set.

Parameters:
  • set_path (str of pathlib.Path) – Path to distributed analysis set folder
  • cleanup (bool, optional) – Delete distributed files after merging (default: False)
merge_setup(joint_file, proc_path)

Merge HDF5 setup from part of a distributed analysis set into a joint file.

Parameters:
  • joint_file (HDF5 file) – Joint file
  • proc_path (str or pathlib.Path) – Path to part of a distributed analysis set
merge_data(joint_file, proc_path)

Merge data from part of a distributed analysis set into a joint file.

Parameters:
  • joint_file (HDF5 file) – Joint file
  • proc_path (str or pathlib.Path) – Path to part of a distributed analysis set
merge_sets(joint_path, set_paths, cleanup=False, comm=MPI.COMM_WORLD)

Merge analysis sets.

Parameters:
  • joint_path (string or pathlib.Path) – Path for merged file.
  • set_paths (list of strings or pathlib.Path objects) – Paths of all sets to be merged
  • cleanup (bool, optional) – Delete set files after merging (default: False)
  • comm (mpi4py.MPI.Intracomm, optional) – MPI communicator (default: COMM_WORLD)
merge_analysis