Validity and inter-observer reliability of subjective hand-arm vibration assessments

Pieter Coenen, Margriet Formanoy, Marjolein Douwes, Tim Bosch, Heleen de Kraker

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Exposure to mechanical vibrations at work (e.g., due to handling powered tools) is a potential occupational risk as it may cause upper extremity complaints. However, reliable and valid assessment methods for vibration exposure at work are lacking. Measuring hand-arm vibration objectively is often difficult and expensive, while often used information provided by manufacturers lacks detail. Therefore, a subjective hand-arm vibration assessment method was tested on validity and inter-observer reliability. In an experimental protocol, sixteen tasks handling powered tools were executed by two workers. Hand-arm vibration was assessed subjectively by 16 observers according to the proposed subjective assessment method. As a gold standard reference, hand-arm vibration was measured objectively using a vibration measurement device. Weighted κ's were calculated to assess validity, intra-class-correlation coefficients (ICCs) were calculated to assess inter-observer reliability. Inter-observer reliability of the subjective assessments depicting the agreement among observers can be expressed by an ICC of 0.708 (0.511-0.873). The validity of the subjective assessments as compared to the gold-standard reference can be expressed by a weighted κ of 0.535 (0.285-0.785). Besides, the percentage of exact agreement of the subjective assessment compared to the objective measurement was relatively low (i.e., 52% of all tasks). This study shows that subjectively assessed hand-arm vibrations are fairly reliable among observers and moderately valid. This assessment method is a first attempt to use subjective risk assessments of hand-arm vibration. Although, this assessment method can benefit from some future improvement, it can be of use in future studies and in field-based ergonomic assessments.

Original languageEnglish
Pages (from-to)1257-62
Number of pages6
JournalApplied Ergonomics
Volume45
Issue number4
DOIs
Publication statusPublished - Jul 2014

Cite this

Coenen, Pieter ; Formanoy, Margriet ; Douwes, Marjolein ; Bosch, Tim ; de Kraker, Heleen. / Validity and inter-observer reliability of subjective hand-arm vibration assessments. In: Applied Ergonomics. 2014 ; Vol. 45, No. 4. pp. 1257-62.
@article{b24687c5915e47608906b008dc074833,
title = "Validity and inter-observer reliability of subjective hand-arm vibration assessments",
abstract = "Exposure to mechanical vibrations at work (e.g., due to handling powered tools) is a potential occupational risk as it may cause upper extremity complaints. However, reliable and valid assessment methods for vibration exposure at work are lacking. Measuring hand-arm vibration objectively is often difficult and expensive, while often used information provided by manufacturers lacks detail. Therefore, a subjective hand-arm vibration assessment method was tested on validity and inter-observer reliability. In an experimental protocol, sixteen tasks handling powered tools were executed by two workers. Hand-arm vibration was assessed subjectively by 16 observers according to the proposed subjective assessment method. As a gold standard reference, hand-arm vibration was measured objectively using a vibration measurement device. Weighted κ's were calculated to assess validity, intra-class-correlation coefficients (ICCs) were calculated to assess inter-observer reliability. Inter-observer reliability of the subjective assessments depicting the agreement among observers can be expressed by an ICC of 0.708 (0.511-0.873). The validity of the subjective assessments as compared to the gold-standard reference can be expressed by a weighted κ of 0.535 (0.285-0.785). Besides, the percentage of exact agreement of the subjective assessment compared to the objective measurement was relatively low (i.e., 52{\%} of all tasks). This study shows that subjectively assessed hand-arm vibrations are fairly reliable among observers and moderately valid. This assessment method is a first attempt to use subjective risk assessments of hand-arm vibration. Although, this assessment method can benefit from some future improvement, it can be of use in future studies and in field-based ergonomic assessments.",
keywords = "Adult, Arm, Construction Industry, Equipment and Supplies/adverse effects, Ergonomics/methods, Hand, Humans, Male, Middle Aged, Observer Variation, Occupational Health/standards, Reproducibility of Results, Vibration/adverse effects",
author = "Pieter Coenen and Margriet Formanoy and Marjolein Douwes and Tim Bosch and {de Kraker}, Heleen",
note = "Copyright {\circledC} 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.",
year = "2014",
month = "7",
doi = "10.1016/j.apergo.2014.03.003",
language = "English",
volume = "45",
pages = "1257--62",
journal = "Applied Ergonomics",
issn = "0003-6870",
publisher = "Elsevier Limited",
number = "4",

}

Validity and inter-observer reliability of subjective hand-arm vibration assessments. / Coenen, Pieter; Formanoy, Margriet; Douwes, Marjolein; Bosch, Tim; de Kraker, Heleen.

In: Applied Ergonomics, Vol. 45, No. 4, 07.2014, p. 1257-62.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Validity and inter-observer reliability of subjective hand-arm vibration assessments

AU - Coenen, Pieter

AU - Formanoy, Margriet

AU - Douwes, Marjolein

AU - Bosch, Tim

AU - de Kraker, Heleen

N1 - Copyright © 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.

PY - 2014/7

Y1 - 2014/7

N2 - Exposure to mechanical vibrations at work (e.g., due to handling powered tools) is a potential occupational risk as it may cause upper extremity complaints. However, reliable and valid assessment methods for vibration exposure at work are lacking. Measuring hand-arm vibration objectively is often difficult and expensive, while often used information provided by manufacturers lacks detail. Therefore, a subjective hand-arm vibration assessment method was tested on validity and inter-observer reliability. In an experimental protocol, sixteen tasks handling powered tools were executed by two workers. Hand-arm vibration was assessed subjectively by 16 observers according to the proposed subjective assessment method. As a gold standard reference, hand-arm vibration was measured objectively using a vibration measurement device. Weighted κ's were calculated to assess validity, intra-class-correlation coefficients (ICCs) were calculated to assess inter-observer reliability. Inter-observer reliability of the subjective assessments depicting the agreement among observers can be expressed by an ICC of 0.708 (0.511-0.873). The validity of the subjective assessments as compared to the gold-standard reference can be expressed by a weighted κ of 0.535 (0.285-0.785). Besides, the percentage of exact agreement of the subjective assessment compared to the objective measurement was relatively low (i.e., 52% of all tasks). This study shows that subjectively assessed hand-arm vibrations are fairly reliable among observers and moderately valid. This assessment method is a first attempt to use subjective risk assessments of hand-arm vibration. Although, this assessment method can benefit from some future improvement, it can be of use in future studies and in field-based ergonomic assessments.

AB - Exposure to mechanical vibrations at work (e.g., due to handling powered tools) is a potential occupational risk as it may cause upper extremity complaints. However, reliable and valid assessment methods for vibration exposure at work are lacking. Measuring hand-arm vibration objectively is often difficult and expensive, while often used information provided by manufacturers lacks detail. Therefore, a subjective hand-arm vibration assessment method was tested on validity and inter-observer reliability. In an experimental protocol, sixteen tasks handling powered tools were executed by two workers. Hand-arm vibration was assessed subjectively by 16 observers according to the proposed subjective assessment method. As a gold standard reference, hand-arm vibration was measured objectively using a vibration measurement device. Weighted κ's were calculated to assess validity, intra-class-correlation coefficients (ICCs) were calculated to assess inter-observer reliability. Inter-observer reliability of the subjective assessments depicting the agreement among observers can be expressed by an ICC of 0.708 (0.511-0.873). The validity of the subjective assessments as compared to the gold-standard reference can be expressed by a weighted κ of 0.535 (0.285-0.785). Besides, the percentage of exact agreement of the subjective assessment compared to the objective measurement was relatively low (i.e., 52% of all tasks). This study shows that subjectively assessed hand-arm vibrations are fairly reliable among observers and moderately valid. This assessment method is a first attempt to use subjective risk assessments of hand-arm vibration. Although, this assessment method can benefit from some future improvement, it can be of use in future studies and in field-based ergonomic assessments.

KW - Adult

KW - Arm

KW - Construction Industry

KW - Equipment and Supplies/adverse effects

KW - Ergonomics/methods

KW - Hand

KW - Humans

KW - Male

KW - Middle Aged

KW - Observer Variation

KW - Occupational Health/standards

KW - Reproducibility of Results

KW - Vibration/adverse effects

U2 - 10.1016/j.apergo.2014.03.003

DO - 10.1016/j.apergo.2014.03.003

M3 - Article

VL - 45

SP - 1257

EP - 1262

JO - Applied Ergonomics

JF - Applied Ergonomics

SN - 0003-6870

IS - 4

ER -