Assessment processes and methods

Redefining Scottish marine geographic areas for the purpose of assessment reporting

When reporting on marine pressures and state there is a requirement to specify the geographic area across which the assessment is relevant. The nature of the assessment areas has evolved over time. An example is Charting Progress 2 (CP2), the second assessment of the state of UK seas reporting on progress in delivering the UK vision, which adopted biogeographic areas (Figure 1). These biogeographic areas are nested within OSPAR Commission (Figure 2) and Marine Strategy Framework Directive (MSFD) (Figure 3) assessment areas. Another example is the UK's Clean and Safe Seas Evidence Group (CSSEG) sampling and reporting framework which incorporates Scottish Sea Areas (SSAs; Figure 4). The CSSEG framework divides UK waters into a set of strata, which are nested within regions. The strata are Water Framework Directive (WFD) water bodies (for coastal and estuarine waters) and larger offshore areas. The entire concept has been based around having nested assessment areas.

MRV Alba na Mara

When assessing if the seas around Scotland are clean, healthy and biologically diverse, as done using ships such as MRV Alba na Mara, the geographic area against which the assessment is made is relevant. © Colin Moffat.

Charting Progress 2 is a comprehensive report on the state of the UK seas. Published in 2010, it provides key findings from UK marine research and monitoring for use by policy makers and others. Scotland contributed to the production of Charting Progress 2 through contributing to the United Kingdom Marine Monitoring and Assessment Strategy (UKMMAS) by both providing data and being an active participant in the various evidence groups and in the Charting Progress 2 Editorial Team.

 

Figure 1: Biogeographic, Charting Progress 2 (CP2) Regions. These have been used as the assessment areas for hazardous substances.
Figure 1: Biogeographic, Charting Progress 2 (CP2) Regions. These have been used as the assessment areas for hazardous substances.

 

Figure 2: OSPAR Convention for the Protection of the Marine Environment of the North-East Atlantic (OSPAR) Regions that overlap with the areas assessed.
Figure 2: OSPAR Convention for the Protection of the Marine Environment of the North-East Atlantic (OSPAR) Regions that overlap with the areas assessed.

 

Figure 3: European Union (EU) Marine Strategy Framework Directive (MSFD) Regions that overlap with the Scottish Sea Area.
Figure 3: European Union (EU) Marine Strategy Framework Directive (MSFD) Regions that overlap with the Scottish Sea Area.

 

Figure 4: European Union (EU) Marine Strategy Framework Directive (MSFD) Regions that overlap with the Scottish Sea Area.
Figure 4: Scottish Sea Areas as used in Scotland's Marine Atlas 2011. These are sub divisions of the biogeographic, or Charting Progress 2 (CP2), Regions.

 

The rationale behind the nested approach to marine areas includes:

  1. a consistent framework for all UK waters;
  2. the strata and regions are based on biogeographic and pressure arguments so have a scientific and management rationale;
  3. enables reporting at the WFD water body level and at CP2, OSPAR and MSFD levels;
  4. the nested framework means that analysis and reporting is simple and coherent at different levels of aggregation; and
  5. statistical sampling designs are easily developed using the strata as building blocks: e.g. stratified random sampling.

Given the historical nature of the biogeographic regions, there are both time-series data and sampling plans that are based around them. Much of the reporting in Scotland's Marine Atlas: Information for the National Marine Plan (2011), used the Scottish Sea Areas (Figure 4).

With the implementation of statutory marine planning, following the publication of Scotland's National Marine Plan, A Single Framework for Managing Our Seas in 2015, the focus turned to the development of regional marine management for the Scottish Marine Regions (SMRs; Figure 5). The eleven SMRs had been designated in the Scottish Marine Regions Order 2015. The statutory nature of the SMRs necessitated a review of the remaining Scottish Sea Areas. This resulted in the creation of non-statutory Scottish Offshore Marine Regions (OMRs). The OMRs (Figure 5, Table 1) were created by Marine Scotland (Figure 5, Table 1). Some offshore regions were not changed. These were Rockall (O9 in Figure 5), Bailey (O8) and Faroe-Shetland Channel (O5). In addition, the limit of the UK Continental Shelf was designated Hatton (O10 in Figure 5). The creation of the OMRs resulted in some minor revision to the existing regions.

The cover for Scotland's National Marine Plan

 

Figure 5: The Scottish Marine Regions (SMRs; S1 – S11) and the Scottish Offshore Marine Regions (OMRs, O1 – O10)
Figure 5: The Scottish Marine Regions (SMRs; S1 – S11) and the Scottish Offshore Marine Regions (OMRs, O1 – O10)

 

Key: S1, Forth and Tay; S2, North East; S3, Moray Firth; S4 Orkney Islands, S5, Shetland Isles; S6, North Coast; S7, West Highlands; S8, Outer Hebrides; S9, Argyll; S10, Clyde; S11, Solway; O1, Long Forties, O2, Fladen and Moray Firth Offshore; O3, East Shetland Shelf; O4, North and West Shetland Shelf; O5, Faroe-Shetland Channel; O6, North Scotland Shelf; O7, Hebrides Shelf; O8, Bailey; O9, Rockall; O10, Hatton.

 

Table 1: Names for the revised Offshore Marine Regions (OMRs).

Original name of residual sea areas following introduction of SMRs (see Figure 4)

New name (Identifier in Figure 5)

Hebrides

Hebrides Shelf (O7)

North Scotland Coast

North Scotland Shelf (O6)

West Shetland

North and West Shetland Shelf (O4)

East Shetland

East Shetland Shelf (O3)

Fladen + portion of Moray Firth

Fladen and Moray Firth Offshore (O2)

Forties + portion East Scotland coast

Long Forties (O1)

 

The SMRs are coastal and were developed on the basis of geopolitical boundaries. Not surprisingly, these do not match with the historical Scottish Sea Areas (SSAs) against which reporting has been made in previous assessments, including Scotland's Marine Atlas in 2011.

For this current assessment, the decision was taken that for hazardous substances and seabed litter, using the SMRs would be complex and make trend assessment complicated. It would also distort the nested approach. However, the need to ensure that a national assessment informed regional assessments as much as possible has meant that as many indicators as possible are based around the SMRs/OMRs with regional comments as appropriate.

Commercial fisheries have been assessed for many years on the basis of regions created by the International Council for the Exploration of the Sea. Within this assessment, these regions have been used for the assessment of fish stocks. However, the SMRs/OMRs have been overlaid to provide context. Fish catches are reported using ICES rectangles. Catch graphs are by Scottish Sea Area (as 2011 Atlas) as attributing to SMRs is not possible. The methodology, used in the Fishing assessment, for assigning rectangles to sea areas uses the following triage/approach:

  1. Rectangles are assigned to sea areas which completely enclose them (Figure 6).

    Where rectangles are split:
  2. Rectangles are assigned to the sea area with the greater square km, or
  3. Rectangles on the continental shelf are assigned to sea area with the greatest square km shallower than 2,000 m, or
  4. Where a rectangle's square km is greater than 50% of a sea area's total square km, it has been assigned to that sea area.*

    (*4 was included for the Forth. On greatest square km, 41E7 would be in East Scotland Coast, but 41E7 also makes up 65% of the Forth area).

In summary:

  1. The biological, physical and economic components of Scotland's Marine Assessment 2020, together with other components are assessed on the basis of the new SMRs and OMRs (Figure 5).
  2. The assessment of hazardous substances and seabed litter is made against the larger biogeographic regions (Figure 1).
  3. Commercial fisheries are assessed using ICES areas and ICES statistical rectangles. Each ICES statistical rectangle is 30 min latitude by 1 degree longitude in size which is approximately 30 nautical miles by 30 nautical miles.

Statutory bodies and the academic community across Scotland are being encouraged to adopt the SMRs/OMRs for future research, monitoring and assessment.

How the ICES rectangles are assigned to the Scottish Sea Areas

Figure 6: How the ICES rectangles (dark blue solid lines) are assigned to the Scottish Sea Areas (light blue dotted lines) as used in Scotland's Marine Atlas 2011 (SSAs as shown in Figure 4).

 


Indicators and assessment criteria

Although this assessment is being produced for a national purpose, internationally agreed indicators and assessment criteria are used where appropriate. The United Kingdom, as a Contracting Party to the OSPAR Commission and as a Member of the European Union, has contributed to the development and implementation of what are now termed common indicators. Scotland has played a critical role in this process over many years especially in the areas of hazardous substances assessments and bird and mammal assessments. Examples of common indicators used in biodiversity assessments include Common Indicator M3 for seal abundance and distribution which is applicable in the North Sea and Common Indicator PH2 which covers plankton biomass and/or abundance and is applicable to both the North Sea and the seas to the west of Scotland. Currently there are 15 biodiversity related common indicators that are applicable to the seas around Scotland, although a few of them cover either the North Sea or the seas to the west of Scotland.

For clean and safe seas, there are seventeen common indicators covering the Themes of Eutrophication, Hazardous substances and their effects, Marine litter, Microbiology and algal toxins and Noise (Table 2). There is a direct correlation between the indicators in SMA2020 and the OSPAR Common Indicators covering eutrophication. For the other Themes, there are some differences. For example, in SMA2020 the concentration of a specific hazardous substance is presented for both biota and sediment in the same assessment. This incorporates two of the OSPAR Common Indicators. There are no OSPAR Common Indicators covering the SMA 2020 Theme Microbiology and algal toxins.

 

Table 2: Assessments under the various Clean and Safe Themes and their relationship with the OSPAR Common Indicators

Theme
SMA 2020 Assessment
OSPAR Common Indicator
No common indicator
No common indicator
No common indicator
No common indicator
No common indicator
No common indicator
No common indicator
No common indicator
No common indicator
No common indicator

Quantitative assessment is preferable to qualitative assessment, although the former is not always possible. For a quantitative assessment to be robust it must include assessment criteria and quality assurance. There are an increasing number of assessments for which assessment criteria and quality assurance processes are available. Within SMA2020 quantitative assessments have been used where they are available.

 


Status, trends and confidence

A key aspect of any assessment is providing an indication of the level of confidence that is attached to the status and trends presented. The natural variation observed in marine systems, coupled with often limited data availability, both on a geographic scale and temporal perspective, makes the confidence assessment highly desirable, but is quantitatively challenging. There are some indicators for which there is a reasonable time series and the assessment includes a rigorous statistical analysis. However, even when this is the case, this may be restricted to coastal areas as distinct from all the Scottish marine areas.

Summarising the status and trends to make the assessment readily accessible is required. A similar approach to presenting the summarised information has been taken in this assessment as was used in Scotland's Marine Atlas 2011. However, it has been developed to include a confidence assessment. The status assessment is again based around the phrases 'Many concerns', 'Some concerns' and 'Few or no concerns'. In addition, there is the description 'Lack of evidence/robust assessment criteria'. The result of each status assessment is represented by an icon. The nature of the regions (or combination of regions) to which the status assessment relates is stated. Although the result of the assessment may be relevant to a significant proportion of the region, there are occasions when it is useful to be able to distinguish variation in a Region e.g. to reflect hotspots. To take account of this, two icons may be combined, with the variation being presented as a small icon superimposed on the main icon (Figure 7).

The trend assessment is represented by a combination of a bar chart icon and an arrow (Figure 7).

 

Status Assessment

Trend Assessment

Status assessment - Red - Many concerns

Many concerns

Trend assessment - No or little change

No / little change

Status assessment - Blue circle - Some concerns

Some concerns

Trend assessment - Increasing trend

Increasing

Status assessment - Green - Few or no concerns

Few or no concerns

Trend assessment - Decreasing trend

Decreasing

Status assessment - Green with blue dot - Few or no concerns, some local concerns

Few or no concerns, some local concerns

No discernible trend

No trend discernible

Status assessment - Green with red dot - Few or no concerns, many local concerns

Few or no concerns, but many local concerns

Trend assessment - all trends
All trends
Status assessment - Blue with red dot - Some concerns, many local concerns

Some concerns, but many local concerns

   
Status assessment - Grey - Lack of evidence/robust assessment criteria

Lack of evidence / robust assessment criteria

   
Status assessment - Grey with green square - Lack of regional evidence/robust assessment criteria, no or few local concerns for some local areas
Lack of regional evidence / robust assessment criteria, but no or few concerns for some local areas    
Status assessment - Grey with blue circle - Lack of regional evidence/robust assessment criteria, some local concerns for some local areas
Lack of regional evidence / robust assessment criteria, but some concerns for some local areas    
Status assessment - Grey with red triangle - Lack of regional evidence/robust assessment criteria, many local concerns for some local areas
Lack of regional evidence / robust assessment criteria, but many concerns for some local areas    

Figure 7: Symbols used for both the status assessment and trend assessment

 

The confidence assessment is presented using stars, the greater the number of stars, the higher the confidence (Figure 8). It is based on the approach developed by the Marine Climate Change Impact Partnership (MCCIP) which is explained in Figure 9. It is based on making a judgement between the level of agreement / consensus (y axis) against the amount of evidence (or data) available (x axis). 

 

Symbol

Confidence Rating

Confidence assessment - one star

Low

Confidence assessment - two  stars

Medium

Confidence assessment - three stars

High

Figure 8: Symbols used to define the confidence rating and their meaning.

Figure 8: MCCIP confidence assessment approach.

Figure 9: MCCIP confidence assessment approach.

 


Linking with the United Nations Sustainable Development Goals

Scotland has implemented a National Performance Framework. The objectives of the Framework are to:

  • create a more successful country
  • give opportunities to all people living in Scotland
  • increase the wellbeing of people living in Scotland
  • create sustainable and inclusive growth
  • reduce inequalities and give equal importance to economic, environmental and social progress

To help achieve its purpose, the Framework sets out eleven 'National Outcomes', including the environment. A number of indicators are used to assess how Scotland is performing against each of the eleven Outcomes. Two of the environmental indicators are:

However, the marine environment contributes to many of the Outcomes, including health and wellbeing and food security.

At the same time, The United Nations has set a series of Sustainable Development Goals. These are 'global goals' and targets that are the blueprint to achieve a better and more sustainable future for all. All countries are aiming to achieve these goals by 2030, through the delivery of the targets associated with each Goal. Scotland's National Performance Framework and the Goals share the same aims. The National Performance Framework is Scotland's way to localising and implementing the targets set within the SDGs. The National Performance Framework has a focus on tackling inequalities so that no one in Scotland is left behind as strides are made together towards the targets within both the National Performance Framework and each of the Sustainable Development Goals.

The National Outcome that covers environment

SDG 14 (Life below water) includes a number of targets to conserve and sustainably use the oceans, sea and marine resources for sustainable development.