54. Jessica Kay Flake: Schmeasurement, making stats engaging, and the Psychological Science Accelerator

BJKS Podcast

Jessica Flake is Assistant Professor for quantitative psychology and modeling at McGill University, where she studies measurement. In this conversation, we talk about her recent paper 'Measurement Schmeasurement: Questionable measurement practices and how to avoid them' (with former guest of the podcast Eiko Fried), how she makes stats lectures interesting, and her work on the Psychological Science Accellarator.
BJKS Podcast is a podcast about neuroscience, psychology, and anything vaguely related, hosted by Benjamin James Kuper-Smith. In 2022, episodes will appear irregularly, roughly twice per month. You can find the podcast on all podcasting platforms (e.g., Spotify, Apple/Google Podcasts, etc.).
Timestamps
0:00:04: Eiko Fried is maybe not that good at p-hacking
0:02:03: How Jessica got into researching measurement
0:10:42: The title of 'Measurement Schmeasurement'
0:16:15: So what is Schmeasurement?
0:24:47: How does Jessica ('literally the best prof ever') make statistics engaging?
0:43:02: Is transparency the solution to schmeasurement?
0:49:56: Was I measuring or schmeasuring in my recent paper?
1:03:39: The next generation of the open science movement
1:15:15: What's it like working on large collaborative projects like The Psychological Science Accelerator?
Podcast links

• Website: https://geni.us/bjks-pod
• Twitter: https://geni.us/bjks-pod-twt

Jessica's links

• Website: https://geni.us/flake-web
• Google Scholar: https://geni.us/flake-scholar
• Twitter: https://geni.us/flake-twt

Ben's links

• Website: https://geni.us/bjks-web
• Google Scholar: https://geni.us/bjks-scholar
• Twitter: https://geni.us/bjks-twt

References
My episode with Eiko Fried: https://geni.us/bjks-fried
The Twitter thread that started schmeasurement: https://twitter.com/JkayFlake/status/917514276893536257
Axelrod (1980). Effective choice in the prisoner's dilemma. Journal of conflict resolution.
Flake & Fried (2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science.
Flake, Pek, & Hehman (2017). Construct validation in social and personality research: Current practice and recommendations. Social Psychological and Personality Science.
Flake, Davidson, Wong, & Pek (2022). Construct validity and the validity of replication studies: A systematic review.
Kuper-Smith, Doppelhofer, Oganian, Rosenblau, & Korn (2021). Risk perception and optimism during the early stages of the COVID-19 pandemic. Royal Society open science.
Moshontz, ... & Chartier, C. R. (2018). The Psychological Science Accelerator: Advancing psychology through a distributed collaborative network. Advances in Methods and Practices in Psychological Science.
Nosek, Beck, Campbell, Flake, Hardwicke, Mellor, ... & Vazire (2019). Preregistration is hard, and worthwhile. Trends in cognitive sciences.
Simmons, Nelson, & Simonsohn (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological science.

Luvut

1. 54. Jessica Kay Flake: Schmeasurement, making stats engaging, and the Psychological Science Accelerator (00:00:00)

2. Eiko Fried is maybe not that good at p-hacking (00:00:04)

3. How Jessica got into researching measurement (00:02:03)

4. The title of 'Measurement Schmeasurement' (00:10:42)

5. So what is Schmeasurement? (00:16:15)

6. How does Jessica ('literally the best prof ever') make statistics engaging? (00:24:47)

7. Is transparency the solution to schmeasurement? (00:43:02)

8. Was I measuring or schmeasuring in my recent paper? (00:49:56)

9. The next generation of the open science movement (01:03:39)

10. What's it like working on large collaborative projects like The Psychological Science Accelerator? (01:15:15)