Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
delcmo committed Dec 29, 2024
1 parent 1cb4fc0 commit 9e548eb
Show file tree
Hide file tree
Showing 5 changed files with 61 additions and 5 deletions.
Binary file added .DS_Store
Binary file not shown.
2 changes: 1 addition & 1 deletion _config.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
title: VERTEX-CFD
logo: docs/figures/logo.png
logo: docs/figures/vertex_cfd_heated_flow_logo.png
description: VERTEX-CFD is a performance portable software package for computational fluid dynamics (CFD) simulations on CPU or GPU architectures.
show_downloads: true
google_analytics:
Expand Down
File renamed without changes
58 changes: 57 additions & 1 deletion paper/paper.bib
Original file line number Diff line number Diff line change
Expand Up @@ -52,4 +52,60 @@ @article{kokkos
volume={33},
number={4},
pages={805-817},
doi={10.1109/TPDS.2021.3097283}}
doi={10.1109/TPDS.2021.3097283}}

# Verification
# TGV
@article{Taylor-green-vortex,
ISSN = {00804630},
URL = {http://www.jstor.org/stable/96892},
author = {G. I. Taylor and A. E. Green},
journal = {Proceedings of the Royal Society of London. Series A, Mathematical and Physical Sciences},
number = {895},
pages = {499--521},
publisher = {The Royal Society},
title = {Mechanism of the Production of Small Eddies from Large Ones},
urldate = {2023-08-29},
volume = {158},
year = {1937}
}

# Double shear layer
@article{PhysRevE.87.013309,
title = {Entropically damped form of artificial compressibility for explicit simulation of incompressible flow},
author = {Clausen, Jonathan R.},
journal = {Phys. Rev. E},
volume = {87},
issue = {1},
pages = {013309},
numpages = {12},
year = {2013},
month = {Jan},
publisher = {American Physical Society},
doi = {10.1103/PhysRevE.87.013309},
url = {https://link.aps.org/doi/10.1103/PhysRevE.87.013309}
}

# Validation
# Natural convection
@article{Kuehn_Goldstein_1976, title={An experimental and theoretical study of natural convection in the annulus between horizontal concentric cylinders}, volume={74}, DOI={10.1017/S0022112076002012}, number={4}, journal={Journal of Fluid Mechanics}, author={Kuehn, T. H. and Goldstein, R. J.}, year={1976}, pages={695–719}} <div></div>
# Flow around a circle
@article{tritton_1959, title={Experiments on the flow past a circular cylinder at low Reynolds numbers}, volume={6}, DOI={10.1017/S0022112059000829}, number={4}, journal={Journal of Fluid Mechanics}, publisher={Cambridge University Press}, author={Tritton, D. J.}, year={1959}, pages={547–567}}

# Flow around a blunt
@article{10.1115/1.3240731,
author = {Lane, J. C. and Loehrke, R. I.},
title = "{Leading Edge Separation From a Blunt Plate at Low Reynolds Number}",
journal = {Journal of Fluids Engineering},
volume = {102},
number = {4},
pages = {494-496},
year = {1980},
month = {12},
abstract = "{The flow over a blunt plate aligned parallel to the stream was visualized using dye tracers. A leading edge separation bubble was observed to form at a Reynolds number based on plate thickness of 100. The steady, laminar separation bubble on a long plate, L/t ≥ 8, grows in size with increasing Reynolds number reaching a maximum streamwise length at Ret = 325. The separated shear layer becomes unsteady and the bubble shrinks in size with further increases in Reynolds number. The leading and trailing edge separation zones on short plates, L/t ≤ 4, may combine to form a large recirculation pocket.}",
issn = {0098-2202},
doi = {10.1115/1.3240731},
url = {https://doi.org/10.1115/1.3240731},
eprint = {https://asmedigitalcollection.asme.org/fluidsengineering/article-pdf/102/4/494/5531330/494\_1.pdf},
}
6 changes: 3 additions & 3 deletions paper/paper.md
Original file line number Diff line number Diff line change
Expand Up @@ -37,17 +37,17 @@ bibliography: paper.bib

# Summary:

The demand for high-performance computational fluid dynamics and multiphysics software packages has grown in recent years as a response to efforts in complex engineering and research applications. While the widespread deployment of high-performance computing (HPC) resources has enabled larger, more complex simulations to be conducted, few commercial or open-source software packages are available which scale performantly on various computing architectures, and represent the multitude of physical processes relevant to these applications. The VERTEX initiative at Oak Ridge National Laboratory is developed to address this technical gap, with a special emphasis on high-fidelity multiphysics modeling of coupled turbulent fluid flow, heat transfer, and magnetohydrodynamics for applications in fusion and fission energy, and other spaces. The VERTEX-CFD module was developed to solve the governing equations of these problems using a high-order continuous Galerkin finite element framework, employing an artificial compressiblity method for pressure-velocity coupling and fully-implicit monolithic solvers. Special attention is being paid during the development process to verify and to validate the solver, and to ensure performance portability across both CPU and GPU computing platforms. A comprehensive verification and validation (V&V) suite and unit tests were designed to assess the accuracy and convergence behavior of the VERTEX-CFD module for problems taken from the published literature.
The demand for high-performance computational fluid dynamics and multiphysics software packages has grown in recent years as a response to effort in complex engineering and research applications. While the widespread deployment of high-performance computing (HPC) resources has enabled larger, more complex simulations to be conducted, few commercial or open-source software packages are available which scale performantly on CPU and GPU computing architectures, and represent the multitude of physical processes relevant to these applications. The VERTEX initiative at Oak Ridge National Laboratory is developed to address this technical gap, with a special emphasis on high-fidelity multiphysics modeling of coupled turbulent fluid flow, heat transfer, and magnetohydrodynamics for applications in fusion and fission energy, and other spaces. The VERTEX-CFD module was developed to solve the governing equations of these problems using a high-order continuous Galerkin finite element framework, and fully-implicit monolithic solvers. Special attention is being paid during the development process to verify and to validate the solver, and to ensure performance portability across both CPU and GPU computing platforms. A comprehensive verification and validation (V&V) suite and unit tests were designed to assess the accuracy and convergence behavior of the VERTEX-CFD module for problems taken from the published literature.

# Statement of need

The core work of the cross-cutting VERTEX Laboratory Directed Research and Development (LDRD) initiative aims to create a new multiphysics simulation framework supporting physical phenomena key to Oak Ridge National Laboratory (ORNL) mission-critical challenges. ORNL has clearly demonstrated needs in modeling and simulation of gas dynamics, rarefied flow, plasma-surface interaction, electromagnetics, magneto-hydrodynamics (MHD), and thermal hydraulics for conducting fluids, collisionless and collisional plasma, and structural mechanics.
As part of the VERTEX initiative, the primary mission of the VERTEX-CFD team is to develop modeling and simulation capabilities to accurately model the physics in fusion blanket design. It thus requires a multiphysics solver to implement the incompressible Navier-Stokes (NS) equation to conjugate a heat transfer model and an MHD solver. Solvers, finite element methods, and other relevant tools are provided by the [Trilinos package](https://trilinos.github.io/) [@trilinos-website]. The VERTEX-CFD solver is designed to scale on HPC platforms by leveraging Kokkos [@kokkos] programming language to ensure compatibility with various CPU and GPU architectures.
As part of the VERTEX initiative, the primary mission of the VERTEX-CFD team is to develop modeling and simulation capabilities to accurately model the physics in fusion blanket design. It thus requires a multiphysics solver to implement the incompressible Navier-Stokes (NS) equation to conjugate a heat transfer model and an MHD solver. Solvers, finite element methods, and other relevant tools are provided by the [Trilinos package](https://trilinos.github.io/) [@trilinos-website]. The VERTEX-CFD solver is designed to scale and to be compatible with various CPU and GPU architectures on HPC platforms by leveraging Kokkos [@kokkos] programming language.


# Current capabilities and development workflow

VERTEX-CFD solver is still under active development and currently implements the following capabilities: incompressible Navier-Stokes equations [@Clausen2013], temperature equation, induction-less and full-induction MHD models, RANS turbulence models and WALE (LES) [@nicoud:hal-00910373] turbulence model. Each new physics is implemented in closure models with unit tests. Physical models and coupling between equations were verified and validated against bechmark problems taken from the published literature: isothermal flows, heated flows, transient and steady-state cases, turbulent cases, and MHD flows. VERTEX-CFD solver has demonstrated second-order temporal and spatial accuracy. Scaling of the VERTEX-CFD solver was assessed on CPUs and GPUs architecture. It was found that strong and weak scaling were comparable to other CFD solvers alike NekRS. (ADD FIGURE).
VERTEX-CFD solver is still under active development and currently implements the following capabilities: incompressible Navier-Stokes equations [@Clausen2013], temperature equation, induction-less and full-induction MHD models, RANS turbulence models and WALE (LES) [@nicoud:hal-00910373] turbulence model. Each new physics is implemented in closure models with unit tests. Physical models and coupling between equations were verified and validated against benchmark problems taken from the published literature: isothermal flows [@Taylor-green-vortex, @10.1115/1.3240731, @PhysRevE.87.013309], heated flows [@Kuehn_Goldstein_1976, @tritton_1959], transient and steady-state cases, turbulent cases, and MHD flows. VERTEX-CFD solver has demonstrated second-order temporal and spatial accuracy. Scaling of the VERTEX-CFD solver was assessed on CPUs and GPUs architecture. It was found that strong and weak scaling were comparable to other CFD solvers alike NekRS. (ADD FIGURE).

The long term objectives of the VERTEX initiative is to facilitate the addition of new physical models by relying on a plug-and-play architecture, and also guarantee the correctness of the implemented model over time. New physics and equations are easily added to the global tree and allow for quick deployment of new physical model on HPC platforms. Such approach can only be made possible by setting clear requirements and review process for all developers contributing to the project code: any changes and additions to the source code is reviewed and tested before being merged. VERTEX-CFD solver is tested daily on a continuous integration (CI) workflow that is hosted on ORNL network.

Expand Down

0 comments on commit 9e548eb

Please sign in to comment.