Methodology

Methodology and sources

Here you can see what our tests measure, how a result is calculated and what to expect from it. The tests are a tool for measuring and training, not for diagnosis.

1. What the tests are and are not

The tests measure reaction, attention, memory, coordination and visual perception in your browser. They are meant for tracking your own progress and as a basis for training.

They are not a medical device. They do not diagnose ADHD, vision problems or any other condition, and they do not replace an examination by a doctor or optometrist. If you have difficulties, see a professional.

2. What the tests are based on

Our tests are our own implementations inspired by established research principles. They are not licensed clinical tests, so their results cannot be compared with laboratory norms.

  • Reaction time and choice reaction: Hick's law, decision time grows with the number of options (Hick, 1952).
  • Attention: continuous performance tasks (Rosvold et al., 1956).
  • Cognitive control: Stroop (1935), the Simon effect (Simon & Rudell, 1967), Go/No-Go and task switching.
  • Memory: n-back (Kirchner, 1958), digit span and spatial memory.
  • Field of view and visual perception: useful field of view (Ball et al., 1988), peripheral vision and contrast.
  • Object tracking: multiple object tracking, studied in sport for example by Faubert (2013).

3. How we calculate a result

  • Speed is the time from stimulus to answer in milliseconds. Answers under 150 ms count as anticipations and very slow ones (over 1.5 s in selected tests) as lapses of attention, so they are not included.
  • Interference tasks (for example the Simon test) are scored with the median and the difference between matching and non-matching trials. The median is less affected by single outliers than the average.
  • Accuracy in n-back and attention is balanced: the average of hits and correctly ignored stimuli. Doing nothing or clicking on everything therefore gives 50 %, not a high score.
  • Unreliable result: if accuracy is too low or too few valid answers were given, we do not rate the result and suggest repeating the test. Speed without accuracy says nothing.
  • Tiers (exceptional, excellent, average, below average) are currently indicative, set from the available literature and experience. Once we have collected enough anonymous aggregated data, we will set them from the real distribution.

4. How to test so the result means something

  • Measure under the same conditions: the same device, a similar time of day, well rested.
  • Do at least three attempts and follow the trend over time, not a single result.
  • A mouse, a screen and sound add delays of tens of milliseconds. Compare only measurements from the same device.

5. What science says about training

Training improves the trained task. Transfer to other situations is smaller and not confirmed in every study: the review by Simons et al. (2016) rates the evidence for broad transfer of “brain-training” programs as limited, and a critical review of the NeuroTracker tool (Vater et al., 2021) points to the weak quality of many studies. At the same time, in older adults speed-of-processing training improved that speed and the effect lasted (ACTIVE; Ball et al., 2002).

That is why we offer measuring and regular training as part of preparation, not as a miracle cure. We do not promise better eyesight or treatment of any condition.

6. Data protection

Your results are stored in your account and you can delete them at any time. A trainer sees only the players who joined the trainer's team and gave their consent, and only the name they chose and their test results. More in the privacy policy.

Sources

  1. Ball, K., Beard, B. L., Roenker, D. L., Miller, R. L., & Griggs, D. S. (1988). Age and visual search: expanding the useful field of view. Journal of the Optical Society of America A, 5(12), 2210–2219.
  2. Ball, K., Berch, D. B., Helmers, K. F., et al. (2002). Effects of cognitive training interventions with older adults: a randomized controlled trial (ACTIVE). JAMA, 288(18), 2271–2281.
  3. Faubert, J. (2013). Professional athletes have extraordinary skills for rapidly learning complex and neutral dynamic visual scenes. Scientific Reports, 3, 1154.
  4. Hick, W. E. (1952). On the rate of gain of information. Quarterly Journal of Experimental Psychology, 4(1), 11–26.
  5. Kirchner, W. K. (1958). Age differences in short-term retention of rapidly changing information. Journal of Experimental Psychology, 55(4), 352–358.
  6. Rosvold, H. E., Mirsky, A. F., Sarason, I., Bransome, E. D., & Beck, L. H. (1956). A continuous performance test of brain damage. Journal of Consulting Psychology, 20(5), 343–350.
  7. Simon, J. R., & Rudell, A. P. (1967). Auditory S-R compatibility: the effect of an irrelevant cue on information processing. Journal of Applied Psychology, 51(3), 300–304.
  8. Simons, D. J., Boot, W. R., Charness, N., et al. (2016). Do “brain-training” programs work? Psychological Science in the Public Interest, 17(3), 103–186.
  9. Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18(6), 643–662.
  10. Vater, C., Gray, R., & Holcombe, A. O. (2021). A critical systematic review of the Neurotracker perceptual-cognitive training tool. Psychonomic Bulletin & Review, 28, 1458–1483. doi:10.3758/s13423-021-01892-2

Frequently asked questions

Are the tests diagnostic?

No. They measure performance in simple tasks but do not diagnose ADHD, vision problems or any other condition. If you have difficulties, see a doctor or an optometrist.

Why is my result marked as unreliable?

Usually because accuracy was low or there were too few valid answers. Such a result would be misleading, so we do not rate it. Try the test again, calmer and more precisely.

Can I compare my results with other people?

With care. A device, mouse, screen and sound all add delay, so comparing between devices is only indicative. The most reliable comparison is with your own earlier measurements.

How often should I test myself?

A few times a week under similar conditions is enough. The trend over weeks matters, not a single day.