
26th-27th October 2005
Bureau of Meteorology
Gary B.
Brassington
g.brassington@bom.gov.au
7 November 2005
BLUElink is a partnership
of the Bureau of Meteorology, CSIRO and Royal Australian Navy to develop
AustraliaÕs first operational ocean forecast system. This project, officially
launched in 2003, sets out a formal schedule for completing the development of
the individual components and prediction system. The prediction system is
scheduled for transfer to operations in December 2006. The June 2005 contract
milestones marked the transition in the BLUElink contract from scientific
development to implementation and scientific validation. The Scientific and
Technical Implementation Plan (STIP) is being developed to provide the detailed
plan of the system configuration and timetable for implementation, trial and
monitoring.
The operational system
throughout the trial period is referred to as the Ocean Model Analysis and
Prediction System or OceanMAPS. OceanMAPS is a global ocean prediction system
with enhanced resolution in AustraliaÕs marginal seas. The system is intended to
provide from 7 to 28 day forecasts making use of the NWP and climatological
fluxes and near real-time observations.
The science and technical implementation plan (STIP) workshop was convened to provide an opportunity to review and refine the plan for the trial Ocean Model Analysis and Prediction System (OceanMAPS) being developed under the BLUElink contract. The STIP describes the complete system including a detailed plan for the configuration of each individual system component. The STIP covers all stages of the implementation from initial configuration through to operational certification scheduled for January 2007.
OceanMAPS is a completely new system with few useful benchmarks in the Bureau or CSIRO. The closest prototype to OceanMAPS at the Bureau is NWP with GASP and LAPS. The timescales of interest and the general structure of the system share many similarities to these systems. However we need to be mindful that the similarities diverge when it comes to the practical implementation. NWP has been established for over 20 years at the Bureau and is now a very mature system. Operational implementations are largely restricted to system upgrades, which have established pathways together with experienced staff to carry it out.
OceanMAPS design
overview
The
design of OceanMAPS must satisfy two goals: (a) robustness and (b) skill.
Compared with NWP operational oceanography is in its infancy and the observing
system can only be considered quasi-operational. In this type of environment
robustness can be difficult to achieve and a sophisticated control system will
be required to account for an elaborate set of contingencies. OceanMAPS has
been composed of several modular systems that can be defined in terms of
interfaces. These systems are shown in Fig.1 and include:
Note the system description has made use of generic component names Ocean Data Assimilation System (ODAS) and Ocean General Circulation Model (OGCM). In the first version of OceanMAPS ODAS and OGCM will be an implementation of BODAS and OFAM respectively.
Ocean observations have the following properties: (a) the observations are sparse in time and space, (b) the observations are only semi-operational and (c) the observation quality increases significantly in time. All of these properties suggest that the near real-time analysed state could introduce biases and error that could lead to more rapid model drift. Three strategies are being considered to remove model drift:
(a) Relaxation of the deep water to climatology
(b) Compute a best estimate of the ocean state using a delayed analysis cycle to include more observations and higher quality observations
(c) Re-introduce a cold start from a climatological/spinup restart.
All three strategies may prove to be necessary at various stages of the system operation. The second strategy is being developed for trials. The best estimate of ocean state obtained from the delayed analysis is used as the starting point for launching a NRT analysis sequence. The NRT analysis is closer to real-time and will have fewer high quality observations and an asymmetric analysis window. This ocean state is used temporarily to produce an ocean forecast. A delayed analysis cycle would incur an additional cost in terms of computations and storage. This will need to be evaluated against the gain in reduced forecast innovations.

Figure
1: Schematic representation of the OceanMAPS system
components and the flow of information

Figure
2: Schematic representation of the proposed analysis
and forecast cycles for OceanMAPS
The
STIP is an explicit plan for the complete implementation of the first version
of OceanMAPS into operations at the Bureau of Meteorology. The STIP covers the
scientific and technical aspects of the system configuration together with a
schedule for the operational trial and monitoring period.
The
draft STIP has been prepared as an online document and exposed on the Bureau
external server at http://www.bom.gov.au/bmrc/ocean/BLUElink/OceanMAPS/.
Broad contributions and participation was sort from BMRC, NMOC, HPCCC, OEB,
CSIRO and the RAN. The draft STIP was made available to these groups for review
and comment leading up to the workshop. Not all of the prepared documentation
was available to participants due problems with the external transfer program.
The complete version is available internally on the Bureau intranet at http://gale.ho.bom.gov.au/bm/internal/ocean/BLUElink/OceanMAPS/.
The
first complete version is expected to be available in November with the
contents as outlined in Appendix A.
The
implementation of the trial system will consist of three phases each of
approximately 6 months duration:
Phase
1 Infrastructure: Implement the trial
system configuration as defined by the STIP. The implementation is further
divided into two sub-systems each of 3 months duration:
The
conclusion of the first three-month period coincides with this workshop. The
analysis cycle will be demonstrated at the workshop and the forecast cycle plan
reviewed.
Phase
2 Tuning: At the conclusion of Phase
1 a complete operational configuration will be available for trials. Phase 2
will conduct and report on the trial schedule defined by the STIP. This phase
is also divided into two sub-components of 3 months:
The
robust configuration will form the backbone of the forecast system and will
include only those components tested and likely to be robust. The robust
configuration might include the GASP fluxes only and an ÒaggressiveÓ QC system.
The extended configuration will include features that are potentially less
robust and need to be tested within the robust configuration. Extensions might
include blended GASP/LAPS fluxes, optimised QC and symmetric and asymmetric
analysis cycles.
Phase
3 Monitoring: Based on the results of
the operational trials in Phase 2 the ÒbestÓ configuration for operational
implementation in December 2006 will be adopted. The ÒbestÓ configuration of
the system will be ÒstaticÓ and assessed for robust delivery of forecasts
throughout the monitoring period.
The specific goals for the monitoring period will include: (a) Monitoring, (b) Routine diagnostics, (c) Validation and skill assessment, (d) Ocean briefings and (e) Documentation complete.
The timetable followed during the workshop is shown in Appendix B which took place over two days. The workshop was broken into 10 one hour component sessions together with an introduction and workshop summary. Each component session was started with two 15 minute presentations that highlighted scientific and technical issues for OceanMAPS implementation. This was followed by a 25 minute session for open discussion on any aspect of the component motivated by the talks or participant questions.
OFAM
BODAS
OceanMAPS
Servicing
High
performance infrastructure
Data
management system
Operational
infrastructure
Satellite
observations
Profile
observations
Surface
fluxes (NWP)
Surface
fluxes (SST relaxation)
The implementation plan proposes to conduct operational trials in the following categories. These categories have been restricted to those experiments or tests that contribute to answering specific questions of the system configuration. The detailed analysis of system performance will be performed in phase 3 monitoring.
A number of system configuration and control system failure testing of the data management and retrieval systems can be performed without the need for the full cost of OFAM and BODAS. The proposition is to be perform these tests with AusCOM which has reduced costs. It is expected that this can be supported under the current experimental NQS scheduler.
Testing the robust configuration will include the full OFAM and BODAS software. OFAM has been performed on 3 nodes and 6 node configurations from CSIRO using priority scheduling. The OceanMAPS operational trials will require a minimum of 3 modes in the configuration trials. A higher priority queueing is expected to be necessary for these trials.
OceanMAPS contains a number of parameters that will require tuning for forecast performance. The present proposal is to perform these experiments by multiple 6month-one year model integrations. A minimum of 3 nodes will be required and priority scheduling required to complete the tests in the operational trial period.
OceanMAPS will be trrialed on a range of node configurations to define the timings relative to resources on the SX6. The results from these experiments will help to define the resource level and the impact to the operational schedule.
Experiments to trial alternative algorithms or subroutines for the software, primarily OFAM and BODAS.
The proposed schedule for the operational trials
|
Trial category |
Nov |
Dec |
Jan |
Feb |
Mar |
Apr |
May |
Jun |
Jul |
|
Model independent trials |
|
|
|
|
|
|
|
|
|
|
Robust configuration |
|
|
|
|
|
|
|
|
|
|
Robust forecast perform. |
|
|
|
|
|
|
|
|
|
|
Multi-node trials |
|
|
|
|
|
|
|
|
|
|
Extended configuration |
|
|
|
|
|
|
|
|
|
The following trials are proposed for OceanMAPS based on the outcomes from the workshop. The category and priority of these trials have not been set for this report.
|
Component |
Trial description |
|
OFAM |
Hybrid mixed layer tuning |
|
OFAM |
Evaluation of no neutral
physics |
|
BODAS |
Impact of smaller
observation windows |
|
BODAS |
Impact of asymmetric
observation windows |
|
BODAS |
Code optimisation |
|
BODAS |
Sensitivity of h_min=200m |
|
BODAS |
Assimilation of surface
velocity observations and MCC fields |
|
OceanMAPS |
Determine the period behind
real-time for the delayed analysis cycle |
|
OceanMAPS |
Determine the size of the
observation windows |
|
OceanMAPS |
Model state robustness,
model drift and reinitialising from a Òcold startÓ |
|
Servicing |
OceanMAPS servicing of
netCDF output for ROAM |
|
High performance
infrastructure |
Tuning of the memory layout |
|
Data management system |
Data archive control
systems for all real-time observations |
|
Data management system |
Data retrieval control
systems for all real-time observations, surface fluxes and datasets |
|
Operational infrastructure |
Trials for ÒcannedÓ
situations |
|
Satellite observations |
Trial of data management of
near real-time sea surface height anomaly observations |
|
Satellite observations |
Assess the density of
observations with period behind real-time |
|
Satellite observations |
Quality control system |
|
Satellite observations |
Trial performance of the
filtered tide gauge observations |
|
Profile observations |
Conversion of GTS to Argo
netCDF format |
|
Profile observations |
Duplicate sorter |
|
Profile observations |
Model and climatological
quality control |
|
Surface fluxes |
GASP heat and mass flux
biases |
|
Surface fluxes |
GASP to OFAM conversion |
|
Surface fluxes |
Assessment of boundary
layer model fluxes |
|
Surface fluxes |
GASP/LAPS blended surface
fluxes |
|
Surface fluxes |
Blended SST analysis
product |
|
Surface fluxes |
Trial the spatial averaging
relaxation |
|
Surface fluxes |
Trial the temporal
averaging relaxation |
|
|
|
The OceanMAPS STIP workshop achieved many
positive outcomes and highlighted a number of issues that the Bureau executive
will need to consider as OceanMAPS begins to emerge. The workshop was very well
attended over the two days with a good turn over of audience as different
specialised sessions occurred. Numerous useful contributions as outlined above
were made by the participants. Some of the specific highlights or issues from
the workshop included:
Servicing
level: RAN expressed an interest in a
daily forecast product to provide initial and boundary condition to the ROAM
system. This is above the twice per week level agreed in the contract. The
higher service level will require up to 3 times the run-time and archive
resources from the system proposed at the workshop
Bureau
servicing: Only limited progress has
been made to define the Òbasic product setÓ that the Bureau will provide to the
public user community. A wide variety of potential products can be derived from
OceanMAPS and the Bureau cannot proceed far without engagement from the user
community. There was agreement with services policy branch that it was
worthwhile inititiating this activity. Phil Parker is proposing to develop a
forum to facilitate this user exchange. Fostering a user community will be
critical activity to justifying the current investment and the operational
resources.
Operational
infrastructure: OceanMAPS is being
developed making use of system infrastructure such as MARS and OPeNDAP that are
yet to attain operational support. Extended delays to this status will impact
OceanMAPS full implementation.
Near
real-time observations: Operational
oceanography is in its infancy with satellite altimetry available in a Òbest
effortsÓ basis only. This is a challenging environment for a robust system and
a more sophisticated control system will be required to account for a wide
range of contingencies.
System
vulnerabilities: The recent failure
of Topex/Poseidon (although expected) has reminded us of the vulnerability of
the ocean prediction system to further satellite failures. Should an additional
satellite failure occur during the operational trial period assimilation of
surface velocity and MCC values will become a critical activity.
OceanMAPS
design: The system is being proposed
to have two analysis cycles. A delayed cycle a couple of days behind real-time
and a forecast analysis which is closer to real-time. This two level analysis
is attempting to make up for inadequacies in the current ocean observing system
where many crucial observations can be delayed by 3 days or more behind
real-time. This structure adds to the computational cost and will need to be
justified by the improved skill of the forecasts.
Optimisation: Assessments of OFAM and BODAS have been made for
resource requirements. Optimistically we can expect a halving in costs from
those of the SPINUP and BRAN.
Resources: OFAM and BODAS have very large resource requirements
on the TX7/SX6 system and in storage. Conducting the operational trials will
require special priority queueing.
Appendix A STIP documentation
The full STIP documentation is available online at http://www.bom.gov.au/bmrc/ocean/BLUElink/OceanMAPS/. Below is an outline of the contents of the STIP. Dates refer to document last revision.
1. STIP background document (26 July 2005)
2. Components
2.1
Ocean Forecast
Australia Model (OFAM)
2.1.1 OFAM specification (19 October 2005)
2.1.2 OFAM grid specification (19 October 2005)
2.1.3 OFAM landsea mask (19 October 2005)
2.2 BLUElink Ocean Data Assimilation System (BODAS)
2.2.1 BODAS specification (19 October 2005)
2.2.2 BODAS prep (20 October 2005)
2.2.3 BODAS calc
2.2.4 BODAS post
2.3 Satellite observations
2.3.1 Jason-1 (19 October 2005)
2.3.2 ENVISAT
2.3.3 Geosat Follow-On (GFO) (19 October 2005)
2.3.4 Coastal sea level anomalies (19 October 2005)
2.4 Profile observations
2.4.1 ARGO (19 October 2005)
2.5 Surface fluxes
2.5.1 GASP (19 October 2005)
2.5.2 LAPS (19 October 2005)
2.5.3 Surface temperature relaxation (20 October 2005)
2.6 Deep restoring
2.6.1 OFAM deep restoring
3. OceanMAPS System Configuration
3.1 Operational archival management (to archive)
3.1.1 Satellite data archival system (20 October 2005)
3.1.2 Profile data archival system (20 October 2005)
3.1.3 BODAS data archival system (25 October 2005)
3.1.4 OFAM data archival system (24 October 2005)
3.2 Operational retrieval management (from archive)
3.2.1 Satellite data retrieval system (19 October 2005)
3.2.2 Profile data retrieval system (19 October 2005)
3.2.3 NWP data retrieval system
3.2.4 BODAS product retrieval system (25 October 2005)
3.2.5 OFAM product retrieval system (24 October 2005)
3.3 Software System Management
3.3.1 OceanMAPS control system (24 October 2005)
3.3.2 BODAS control system (25 October 2005)
3.3.3 OFAM control system (24 October 2005)
3.4 Analysis and forecast systems
3.4.1 Delayed/symmetric analysis cycle (19 October 2005)
3.4.2 Realtime/asymmetric forecast cycle
4. Data Servicing
4.1 Product delivery mechanisms
4.1.1 MARS retrieval system
4.1.2 OPeNDAP retrieval system
4.1.3 Live Access Server (LAS) system
4.2 Archived Data Products
4.2.1 Observational data products
4.2.2 BODAS model products
4.2.3 OFAM model products
4.2.4 GODAE products
4.3 RAN METOC
4.4 ROAM
5. OceanMAPS verification and validation
5.1 Metrics
5.1.1 Skill scores
5.1.2 Assimilation measures
5.1.3 Mesoscale metrics
5.2 Model intercomparisons
5.2.1 NRL
5.2.2 GODAE partners
5.3 Routine monitoring / system integrity
5.3.1 Observational Profile Data
5.3.2 Observational Satellite Data
5.3.3 NWP Surface Flux diagnostics
5.3.4 Model component diagnostics
5.3.5 IT performance
5.4 Robustness, vulnerabilities, and Strategies
5.4.1 Profile data retrieval analysis
5.4.2 Satellite data retrieval analysis
5.4.3 NWP surface flux analysis
5.4.4 OceanMAPS control system analysis
5.4.5 BODAS control system analysis
5.4.6 OFAM control system analysis
5.4.7 BODAS product archival analysis
5.4.8 OFAM product archival analysis
6. Operational trials
6.1 Model independent
6.2 Robust Configuration
6.3 Robust forecast performance tuning
6.4 Multi-node
6.5 Extended Configuration
|
OceanMAPS Science and Technical Implementation
Plan Workshop Wednesday 26th October 2005 |
|||
|
Session Times |
Discussion Times |
Chair/speaker |
Topic |
|
9.00 |
Introduction |
||
|
9.00-9.15 |
Gary Brassington |
Workshop welcome and scope |
|
|
9.15-9.30 |
Andreas Schiller |
BLUElink introduction |
|
|
9.30 |
Ocean services / user community |
||
|
9.30-9.45 |
Rick Bailey |
Bureau Ocean Services |
|
|
9.45-10.00 |
Robert Woodham |
METOC services |
|
|
10.00 |
Morning tea |
||
|
10.15 |
Ocean Forecast Australia
Model (OFAM) |
||
|
10.15-10.30 |
Andreas Schiller |
Design and scientific
performance |
|
|
10.30-10.45 |
Russell Fiedler,Tim Pugh |
OFAM performance on HPCCC |
|
|
10.45-11.10 |
Gary Brassington (Chair) |
OceanMAPS component STIP
|
|
|
11.15 |
BLUElink Ocean Data
Assimilation System / Model evaluation |
||
|
11.15-11.30 |
Gary Brassington |
Design and performance of
BODAS in Bureau |
|
|
11.30-11.45 |
Schiller/Griffin |
GODAE metrics / BRAN |
|
|
11.30-12.10 |
Gary Brassington (Chair) |
OceanMAPS component STIP
|
|
|
12.15 |
Lunch |
||
|
1.00 |
Ocean Model Analysis and
Prediction System (OceanMAPS) |
||
|
1.00-1.15 |
Gary Brassington |
System design |
|
|
1.15-1.30 |
Gary Brassington, Tim Pugh |
Implementation phases:
|
|
|
1.30-1.55 |
Gary Brassington (Chair) |
OceanMAPS system STIP
|
|
|
2.00 |
Servicing |
||
|
2.00-2.15 |
Tennessee Leeuwenburg |
OPeNDAP: Internal/external
access to archived datasets |
|
|
2.15-2.30 |
Peter Craig |
ROAM servicing issues |
|
|
2.30-2.55 |
Gary Brassington (Chair) |
OceanMAPS infrastructure
STIP
|
|
|
3.00 |
Afternoon tea |
||
|
3.15 |
High performance infrastructure |
||
|
3.15-3.30 |
Phil Tannenbaum |
HPCCC infrastructure for
operations |
|
|
3.15-3.45 |
Tim Pugh |
HPCCC infrastructure for
OceanMAPS |
|
|
3.45-4.10 |
Gary Brassington (Chair) |
OceanMAPS infrastructure
STIP
|
|
|
OceanMAPS Science and Technical Implementation
Plan Workshop Thursday 27th October 2005 |
|||
|
Session Times |
Discussion Times |
Chair/speaker |
Topic |
|
9.00 |
Data management system |
||
|
9.00-9.15 |
Graham Warren |
Infrastructure |
|
|
9.15-9.30 |
Mikhail Entel, Tan Le |
MARS |
|
|
9.30-9.55 |
Gary Brassington (Chair) |
OceanMAPS infrastructure
STIP
|
|
|
10.00 |
Morning tea |
||
|
10.15 |
Operational
infrastructure |
||
|
10.15-10.30 |
Graham Warren |
NMOC systems: path to
operational implementation |
|
|
10.30-10.45 |
Tim Pugh |
SMS and operational
scheduler |
|
|
10.45-10.55 |
Gary Brassington (Chair) |
OceanMAPS STIP
|
|
|
11.00 |
Satellite observations |
||
|
11.00-11.15 |
Mikhail Entel, David Griffin |
Satellite altimeters, sea
level anomalies and coastal tide gauge |
|
|
11.15-11.30 |
Mikhail Entel |
Near real-time observations
(Servers) |
|
|
11.30-11.55 |
Gary Brassington (Chair) |
OceanMAPS component STIP
|
|
|
12.00 |
Lunch |
||
|
1.00 |
Profile observations |
||
|
1.00-1.20 |
Claire Spillman |
Argo and duplicate checker |
|
|
1.20-1.30 |
Oscar Alves, Gary Brassington |
Quality control |
|
|
1.30-1.55 |
Gary Brassington (Chair) |
OceanMAPS component STIP
|
|
|
2.00 |
Surface fluxes |
||
|
2.00-2.15 |
Eric Schulz |
GASP/LAPS |
|
|
2.15-2.30 |
Helen Beggs |
Surface temperature
relaxation |
|
|
2.30-2.55 |
Gary Brassington (Chair) |
OceanMAPS system STIP
|
|
|
3.00 |
Afternoon tea |
||
|
3.00 |
Workshop review |
||
|
3.00-3.30 |
Gary Brassington |
Workshop summary and close |
|