- Title
- Success rate validity of peer assessment for research grant applications
- Creator
- Burhan, Ibrahim; Kim, Ho Sung
- Relation
- Collnet Journal of Scientometrics and Information Management Vol. 11, Issue 2, p. 341-359
- Publisher Link
- http://dx.doi.org/10.1080/09737766.2017.1321729
- Publisher
- Taylor & Francis
- Resource Type
- journal article
- Date
- 2017
- Description
- The peer assessment of research grant applications has a long history of controversy and criticisms. Its validity, nevertheless, has been a difficult task in the absence of the assessment standards. For improvement of the assessment validity, a validity of success rate as a functional component of the peer assessment of research grant applications is studied in this paper. Two different kinds of true peers were conceptualized and defined - one is for inherent true peers independent of, and the other for apparent true peers dependent on, how assessment is arranged - to find the low and upper bounds of assessment uncertainty. Validity order was derived for various generic cases of assessment arrangement using the set theory concept for the apparent true peers. Formulas for validity of success rate for research grant applications were derived, which may be useful for assessment planning and streamlining diverted anecdotal opinions on the funding success rate in the literature. A case study was conducted using Australian Research Council (ARC) data available in the literature to demonstrate practicality and significance for the derived validity formulas of success rate.
- Subject
- peer assessment; success rate; validity; grant application; uncertainty; parametric uncertainty model
- Identifier
- http://hdl.handle.net/1959.13/1389118
- Identifier
- uon:32852
- Identifier
- ISSN:0973-7766
- Rights
- This is an Accepted Manuscript of an article published by Taylor and Francis in the Collnet Journal of Scientometrics and Information Management on 9 November 2017, available online: https://www.tandfonline.com/doi/abs/10.1080/09737766.2017.1321729.
- Language
- eng
- Full Text
- Reviewed
- Hits: 898
- Visitors: 980
- Downloads: 102
| Thumbnail | File | Description | Size | Format | |||
|---|---|---|---|---|---|---|---|
| View Details Download | ATTACHMENT02 | Author final version | 366 KB | Adobe Acrobat PDF | View Details Download |