```html Scientific Computing

Scientific Computing

This site is maintained by Stephen Kirkup of the University of Lancashire.

Mathematics, algorithms, computer science and high-performance computing applied to scientific discovery

Simulation • Numerical Analysis • Data • Modelling • Supercomputing

1. What Is Scientific Computing?

Scientific computing is the use of computers, mathematical algorithms and numerical methods to investigate scientific and engineering problems.

It occupies the intersection of mathematics, computer science, physics, engineering and the natural sciences. Scientific computing allows researchers to solve mathematical problems, simulate physical systems, analyse experimental data and investigate phenomena that may be difficult, expensive or impossible to study directly.

Scientific computing can be viewed as a third pillar of scientific investigation.

Alongside theory and experiment, computational methods allow scientists to construct models, perform numerical experiments, analyse enormous datasets and explore complex systems.

Major activities

2. Scientific Computing at the Intersection of Disciplines

Scientific computing brings together several areas of knowledge. A successful computational investigation normally requires understanding both the scientific problem and the computational methods used to solve it.

Mathematics

Provides differential equations, linear algebra, numerical analysis, probability, statistics and optimisation.

The LinkedIn Group Mathematics has been created to connect the people interested in mathematics. You can also link to the LinkedIn profile Mathematical Modeller.

Physics

Supplies mathematical models describing mechanics, electromagnetism, quantum systems, fluids and other physical phenomena.

Engineering

Uses computational methods to design, analyse and optimise complex systems.

The LinkedIn Group CAD CAM CAE has been created to connect the people interested in the CAD CAM CAE field. You can also link to the LinkedIn profile CAD CAM CAE.

Statistics

Provides methods for analysing uncertainty, experimental data and probabilistic models.

Data Science

Provides techniques for extracting information from large and complex scientific datasets.

3. Mathematical Modelling

Mathematical modelling converts a scientific problem into a mathematical representation that can be analysed computationally.

A model may contain algebraic equations, ordinary differential equations, partial differential equations, probability distributions or systems of coupled equations.

Physical System
→
Mathematical Model
→
Numerical Method
→
Computer Program
→
Scientific Result

Examples of mathematical models

The LinkedIn Group Mathematics has been created to connect the people interested in mathematics. You can also link to the LinkedIn profile Mathematical Modeller.

The site www.appliedmathematics.info provides a resource on Applied Mathematics.

4. Numerical Methods

Many scientific equations cannot be solved analytically for realistic systems. Numerical methods provide approximate solutions using algorithms that can be executed by computers.

Numerical Integration

Algorithms approximate definite integrals when an exact analytical solution is unavailable or impractical.

Numerical Differentiation

Derivatives can be approximated from discrete numerical data.

Linear Algebra

Matrix operations and linear-system solvers are fundamental to many scientific calculations.

Numerical Optimisation

Algorithms search for minima, maxima or optimal solutions within complex parameter spaces.

Ordinary Differential Equations

Numerical integrators approximate the evolution of dynamical systems.

Partial Differential Equations

PDE solvers model spatially and temporally varying physical systems.

The LinkedIn Group Numerical Methods has been created to connect the people interested in the numerical mathematics field. You can also link to the LinkedIn profile Numerical Analyst.

The site www.numerical-methods.com provides a resource on Numerical Methods/Analysis.

5. Numerical Accuracy and Error

Scientific computing requires careful consideration of numerical error. A computational result is not automatically correct simply because a program executes successfully.

Type of Error Description
Round-off Error Error caused by representing real numbers with finite precision on a computer.
Truncation Error Error introduced when an infinite mathematical process is approximated by a finite computational procedure.
Discretisation Error Error resulting from representing continuous systems using discrete numerical grids or points.
Model Error Difference between a mathematical model and the real physical or scientific system.
Input Error Uncertainty or inaccuracies in measured or supplied data.

6. Scientific Simulation

Scientific simulation uses a computer to reproduce the behaviour of a mathematical model representing a real or theoretical system.

Simulation allows researchers to perform computational experiments by changing parameters and observing the resulting behaviour.

Astrophysical Simulation

Models stars, galaxies, black holes, cosmological structure and the evolution of the Universe.

Climate Simulation

Models the atmosphere, oceans, land surface, ice and interactions within the Earth system.

Fluid Dynamics

Simulates the behaviour of liquids and gases.

Structural Simulation

Predicts stresses, strains, deformation and failure in engineered structures.

Particle Physics

Computational models help interpret high-energy particle interactions and experimental data.

Quantum Simulation

Computational techniques investigate quantum systems and molecular behaviour.

7. High-Performance Computing

High-performance computing (HPC) uses powerful computing systems to perform computationally demanding scientific workloads.

HPC systems may contain thousands or millions of processor cores, large memory systems, high-speed interconnects and specialised accelerators.

Scientific computing and HPC are closely connected.

Increasingly realistic simulations often require computational resources far beyond those available on an ordinary desktop computer.

HPC Component Purpose
CPU General-purpose computational processing.
GPU Highly parallel numerical calculations and specialised scientific workloads.
Memory Stores computational data required by running programs.
High-Speed Network Enables rapid communication between compute nodes.
Parallel File System Provides high-throughput access to large datasets.
Job Scheduler Allocates computational resources to users and applications.

8. Distributed Scientific Computing

Large scientific problems can be divided across many computers. Distributed computing allows researchers to use clusters, grids and cloud infrastructure for large-scale computation.

Scientific Problem
→
Divide Work
→
Compute Nodes
→
Combine Results
→
Analysis

Applications

9. Scientific Data Computing

Modern experiments and instruments can generate enormous volumes of data. Scientific computing provides methods for storing, processing, analysing and visualising these datasets.

Data Acquisition

Scientific instruments and sensors generate measurements.

Data Storage

Large datasets require specialised storage systems and data-management strategies.

Data Processing

Raw measurements can be cleaned, calibrated and transformed.

Statistical Analysis

Statistical methods identify patterns, relationships and uncertainties.

Visualisation

Graphs, images and interactive visualisations make complex scientific datasets easier to interpret.

Reproducibility

Computational workflows should allow results to be independently reproduced and verified.

10. Artificial Intelligence in Scientific Computing

Artificial intelligence and machine learning are increasingly being integrated with scientific computing.

Machine-learning methods can identify patterns in scientific datasets, approximate computationally expensive functions, assist simulations and help scientists analyse experimental observations.

Examples

11. Programming for Scientific Computing

Scientific computing relies on a range of programming languages and software environments.

Technology Typical Scientific Uses
Python Data analysis, numerical computing, machine learning, visualisation and scientific workflows.
Fortran Long-established numerical and high-performance scientific applications.
C / C++ High-performance numerical software, simulations and scientific libraries.
Julia Numerical computing and high-performance scientific programming.
MATLAB Numerical analysis, modelling, simulation and engineering.
R Statistics, data analysis and visualisation.

12. Scientific Libraries and Frameworks

Researchers normally build applications using established numerical, statistical and scientific software libraries rather than implementing every mathematical operation from scratch.

NumPy

Numerical arrays and mathematical operations in Python.

SciPy

Scientific algorithms covering optimisation, integration, interpolation, signal processing and more.

Matplotlib

Scientific plotting and data visualisation.

Jupyter

Interactive computational notebooks combining code, mathematics, data and explanation.

MPI

Message-passing infrastructure for distributed and parallel scientific applications.

OpenMP

Shared-memory parallel programming for multicore systems.

13. Applications of Scientific Computing

Astronomy

Simulating galaxies, stars and cosmological structures, and processing observations from telescopes.

Physics

Modelling physical systems ranging from elementary particles to condensed matter.

Chemistry

Computational chemistry uses numerical methods to study molecular structures and chemical reactions.

Biology

Genomics, molecular biology, systems biology and population modelling.

Medicine

Medical imaging, computational physiology and biomedical modelling.

Climate Science

Numerical models investigate climate and Earth-system behaviour.

Engineering

Computational fluid dynamics, finite-element analysis, optimisation and digital twins.

Earth Sciences

Geophysical modelling, seismic analysis, geological simulation and environmental modelling.

Materials Science

Computational models investigate materials at atomic, microscopic and macroscopic scales.

Oceanography

Models simulate ocean circulation, waves, temperature and interactions with the atmosphere.

Computational Social Science

Large datasets and computational models can be used to investigate social systems and behaviour.

Space Science

Space missions generate complex datasets requiring substantial computational analysis.

14. Computational Fluid Dynamics

Computational Fluid Dynamics (CFD) is a major branch of scientific and engineering computing concerned with the numerical solution of equations describing fluid flow.

CFD is used to study airflow around aircraft, combustion, weather systems, ocean currents, industrial processes and many other fluid-dynamical systems.

Typical CFD workflow:

Define geometry → generate computational mesh → specify physical models and boundary conditions → solve governing equations → analyse and visualise results.

The LinkedIn Group Computational Mechanics Research has been created to connect the people interested in the computational mechanics field. You can also link to the LinkedIn profile Numerical Analyst.

15. Finite Element Analysis

The Finite Element Method (FEM) divides a complex physical domain into many smaller elements. The governing equations are then solved approximately over this computational mesh.

Finite-element analysis is widely used for structural mechanics, heat transfer, electromagnetics, fluid mechanics and multiphysics engineering problems.

Engineering applications

The LinkedIn Group Computational Mechanics Research has been created to connect the people interested in the computational mechanics field. You can also link to the LinkedIn profile Numerical Analyst.

16. Computational Chemistry

Computational chemistry uses numerical algorithms and computer simulations to investigate molecular and chemical systems.

Depending on the method, calculations can investigate electronic structure, molecular dynamics, chemical reactions, molecular properties and interactions between molecules.

Quantum Chemistry

Uses quantum-mechanical models to calculate molecular and electronic properties.

Molecular Dynamics

Simulates the movement and interactions of atoms and molecules over time.

Materials Modelling

Computational methods investigate the properties and behaviour of materials.

Drug Discovery

Computational techniques can help investigate molecular interactions and candidate compounds.

17. Computational Astronomy

Astronomy has become increasingly computational as modern observatories generate enormous quantities of data.

Scientific computing is used to process telescope observations, simulate stars and galaxies, analyse gravitational systems, model cosmological evolution and investigate black holes.

The LinkedIn Group Aerospace Engineering Innovation has been created to connect the people interested in astronomy as well as in the aerospace field. You can also link to the LinkedIn profile Aerospace Engineer.

18. Reproducible Scientific Computing

Reproducibility is a fundamental principle of computational science. Scientific results should ideally be traceable to the data, algorithms, software and parameters used to generate them.

Good computational practice includes:

19. Verification and Validation

Verification and validation are essential when computational models are used to produce scientific conclusions.

Concept Question
Verification Has the computational model been implemented correctly?
Validation Does the model adequately represent the real system for the intended purpose?
Uncertainty Quantification How uncertain are the model inputs and computational results?

20. Visualisation

Scientific visualisation transforms numerical results into graphical representations that researchers can interpret.

Graphs

Display relationships between numerical variables.

Scientific Images

Represent spatial distributions, simulations and experimental observations.

3D Visualisation

Allows researchers to examine three-dimensional scientific structures and computational domains.

Interactive Visualisation

Enables researchers to explore large datasets dynamically.

21. Scientific Computing Workflow

Question
→
Model
→
Algorithm
→
Implementation
→
Computation
→
Analysis
→
Validation

The workflow is normally iterative. Researchers may modify the model, numerical method or computational implementation after analysing the results.

22. Advantages of Scientific Computing

Scale

Computers can investigate systems involving enormous numbers of variables and calculations.

Speed

Modern processors can perform billions or trillions of numerical operations rapidly.

Experimentation

Computational experiments can explore parameter ranges that would be difficult to investigate physically.

Safety

Dangerous or inaccessible scenarios can sometimes be investigated computationally.

Cost Reduction

Simulation can reduce the number of expensive physical prototypes or experiments required during development.

Discovery

Computation can reveal patterns and behaviours that may not be obvious from theory or experiment alone.

23. Challenges

Computational Cost

High-fidelity simulations can require enormous amounts of processing power.

Numerical Stability

Poorly designed numerical methods can produce unstable or inaccurate results.

Model Complexity

Real-world systems can contain many interacting physical processes.

Large Datasets

Scientific instruments can produce datasets that are difficult to store and process.

Software Complexity

Large scientific programs may contain millions of lines of code and complex dependencies.

Validation

Computational predictions must be compared with appropriate theory, observations or experiments.

24. Scientific Computing and Supercomputers

Supercomputers provide some of the most powerful computational platforms available for scientific research.

They are used for workloads including climate modelling, computational fluid dynamics, nuclear simulations, astrophysics, materials science, genomics and artificial intelligence.

Supercomputing transforms scientific questions into computational experiments at unprecedented scale.

The combination of massive parallelism, high-speed networks, specialised processors and large-scale storage allows researchers to simulate systems that would otherwise be computationally inaccessible.

25. Digital Twins

A digital twin is a computational representation of a physical object, process or system that can be updated using data from the corresponding real-world system.

Digital twins combine scientific modelling, simulation, sensors, data analysis and computing infrastructure.

Applications

26. Scientific Computing and the Digital Research Environment

Modern computational science increasingly uses a combination of local workstations, institutional clusters, national supercomputers, cloud platforms and distributed computing systems.

Platform Typical Role
Desktop / Workstation Development, visualisation and smaller simulations.
Departmental Cluster Medium-scale computational workloads.
Supercomputer Very large simulations and highly parallel workloads.
Cloud Computing Flexible, scalable computational infrastructure.
Distributed Grid Cooperation between geographically distributed resources.

27. History of Scientific Computing

1940s–1950s

Early electronic computers begin solving numerical problems in physics, engineering and mathematics.

1960s–1970s

Numerical analysis, computational physics and scientific programming become established disciplines.

1980s

Vector supercomputers and increasingly sophisticated numerical software enable larger simulations.

1990s

Massively parallel computing, scientific visualisation and the growth of computational science transform research.

2000s

Clusters, grids, distributed computing and large scientific datasets become increasingly important.

2010s

GPUs, cloud computing, big-data techniques and machine learning expand computational science.

2020s

AI, exascale computing, digital twins and increasingly data-intensive scientific instruments accelerate the development of computational research.

28. The Future of Scientific Computing

Exascale Computing

Extremely powerful systems enable larger and more detailed scientific simulations.

AI-Enhanced Science

Machine learning will increasingly complement traditional numerical modelling and scientific analysis.

Quantum Computing

Quantum processors may eventually provide new approaches to selected scientific and optimisation problems.

Autonomous Laboratories

Robotics, AI and scientific computing can combine to automate experimental discovery.

Digital Twins

Increasingly sophisticated computational models will represent complex physical systems in real time.

Open Science

Open data, open software and reproducible computational workflows will remain important to scientific research.

29. Scientific Computing in the UK

The United Kingdom has a substantial scientific-computing ecosystem involving universities, national research facilities, government organisations and technology companies.

UK researchers use computational methods across astronomy, particle physics, climate science, computational chemistry, engineering, biology and many other disciplines.

Related UK research areas

30. Scientific Computing as a Discipline

Scientific computing is now a mature interdisciplinary field rather than simply a collection of programming techniques.

It combines mathematical theory, numerical algorithms, computer architectures, software engineering, data analysis and scientific domain knowledge.

The central objective is not computation for its own sake.

The purpose of scientific computing is to use computation to obtain reliable scientific knowledge, make predictions, test hypotheses and solve problems.

31. Conclusion

Scientific computing has become fundamental to modern science and engineering. Computers allow researchers to solve complex mathematical equations, perform numerical experiments, simulate physical systems and analyse datasets of extraordinary size.

Its scope extends from a scientist running a numerical model on a workstation to international research collaborations using supercomputers, distributed computing infrastructure and artificial intelligence.

The future of scientific discovery will increasingly involve the interaction of theory, experiment, data and computation. Scientific computing therefore provides one of the essential foundations of twenty-first-century research.

32. Further Areas of Study

Numerical Analysis

Mathematical analysis of numerical algorithms and their accuracy, stability and convergence.

Computational Physics

Computational investigation of physical systems.

Computational Chemistry

Numerical investigation of molecules, materials and chemical processes.

Computational Engineering

Simulation and optimisation of engineered systems.

High-Performance Computing

Parallel and distributed computation on powerful computing systems.

Scientific Machine Learning

Integration of machine learning with mathematical modelling and scientific simulation.

Research Software Engineering

Professional software-development practices applied to scientific research.

Computational Data Science

Large-scale processing, statistical analysis and interpretation of scientific datasets.