Background Capillary refill time (CRT) is a clinical test used to evaluate the circulatory status of patients; various methods are available to assess CRT. Conventional clinical research often demands large numbers of patients, making it costly, labor-intensive, and time-consuming. We studied the interobserver agreement on CRT in a nationwide study by using a novel method of research called flash mob research (FMR). Methods Physicians in the Netherlands were recruited by using word-of-mouth referrals, conventional media, and social media to participate in a nationwide, single-day, “nine-to-five,” multicenter, cross-sectional, observational study to evaluate CRT. Patients aged ≥ 18 years presenting to the ED or who were hospitalized were eligible for inclusion. CRT was measured independently (by two investigators) at the patient's sternum and distal phalanx after application of pressure for 5 s (5s) and 15 s (15s). Results On October 29, 2014, a total of 458 investigators in 38 Dutch hospitals enrolled 1,734 patients. The mean CRT measured at the distal phalanx were 2.3 s (5s, SD 1.1) and 2.4 s (15s, SD 1.3). The mean CRT measured at the sternum was 2.6 s (5s, SD 1.1) and 2.7 s (15s, SD 1.1). Interobserver agreement was higher for the distal phalanx (κ value, 0.40) than for the sternum (κ value, 0.30). Conclusions Interobserver agreement on CRT is, at best, moderate. CRT measured at the distal phalanx yielded higher interobserver agreement compared with sternal CRT measurements. FMR proved a valuable instrument to investigate a relatively simple clinical question in an inexpensive, quick, and reliable manner.