Re: Reproducibility

1

I flunked.


Posted by: chill | Link to this comment | 09- 7-18 8:05 AM
horizontal rule
2

I was utterly average.


Posted by: Mossy Character | Link to this comment | 09- 7-18 8:29 AM
horizontal rule
3

32/42--better than the "average individual", lower than the professionals and the median answer. I was basically at chance on the last group, where the descriptions were wordier and described more complex experiments. The entire process felt like being a psych experiment, including the choice of whether or not to continue. So presumably it was one.


Posted by: dalriata | Link to this comment | 09- 7-18 8:40 AM
horizontal rule
4

3: They basically say as much.
I stopped at 10. "14.7 out of 21"


Posted by: Mossy Character | Link to this comment | 09- 7-18 8:55 AM
horizontal rule
5

3: I assume it would invalidate the experiment if I actually read the details.


Posted by: dalriata | Link to this comment | 09- 7-18 8:56 AM
horizontal rule
6

34. Three of my misses were when I went against my heuristics of guessing ideological studies, studies with difficult to measure outcomes, and studies relying on self-reporting would not replicate.


Posted by: Eggplant | Link to this comment | 09- 7-18 8:58 AM
horizontal rule
7

36/42, not bad.

I can't shake the feeling that I have just contributed a data point for some other experiment, though.


Posted by: Nathan Williams | Link to this comment | 09- 7-18 9:14 AM
horizontal rule
8

28/42.


Posted by: Minivet | Link to this comment | 09- 7-18 9:16 AM
horizontal rule
9

34 out of 42. Helped by some familiarity with the reproducibility crisis.


Posted by: politicalfootball | Link to this comment | 09- 7-18 9:49 AM
horizontal rule
10

22/42. I wish I could say I had been flipping coins.


Posted by: Cyrus | Link to this comment | 09- 7-18 10:40 AM
horizontal rule
11

I did as well as professionals! I think this was because I'd read a good bit about all those "priming" studies and how they don't replicate very well, so basically I just assumed that if a study didn't involve priming it was replicable.


Posted by: Frowner | Link to this comment | 09- 7-18 12:40 PM
horizontal rule
12

Same as Minivet


Posted by: FB | Link to this comment | 09- 7-18 10:18 PM
horizontal rule
13

In conclusion, I loathe Shankar Vedantam.


Posted by: Sir Kraab | Link to this comment | 09- 8-18 9:31 PM
horizontal rule
14

36. All my wrong answers I was too skeptical.


Posted by: Beefo Meaty | Link to this comment | 09- 9-18 5:12 AM
horizontal rule
15

I don't work at a university anymore, so I decided it wasn't my problem.


Posted by: Moby Hick | Link to this comment | 09- 9-18 5:49 AM
horizontal rule
16

34. Both too skeptical like Sifu and too lazy (mostly) to read the full study descriptions. I'm always vaguely saddened about priming, because I remember charming conversations with a friend's wife, who is now a professor in a social science and did much of her graduate work on priming (ie does bubbling in the F bubble cause girls to underperform on standardized math tests).


Posted by: ydnew | Link to this comment | 09- 9-18 6:14 AM
horizontal rule
17

||

I was flattered into running a 5 part discussion series for faculty and staff at Heebie U, and I'm preparing for the 2nd discussion.

The problem is that because I've blogged here for 10+ years, I have a *very* finely attuned sense of what generates conversation and what doesn't. (Obviously I'm wrong sometimes, and also sometimes I post something knowing it won't generate conversation. Nevertheless.)

This topic is not worth 5 discussions by any stretch. You could lecture on it and generate 5 classes worth, and if these were your students, you could leverage your goodwill as their instructor to get them to grudgingly play along and think of something to say and contribute. But this is my peers, and they are only going to talk if they want to, and the first discussion had way too much *crickets* and I burned through all my planned discussion questions within the first third.

I keep going back and forth with the organizers and since I'm not willing to say I HAVE A LOT OF EXPERIENCE HERE AND THIS IS A TERRIBLE PLAN, I just keep receiving gentle encouragement. I am suffering greatly.


Posted by: heebie-geebie | Link to this comment | 09- 9-18 8:53 AM
horizontal rule
18

Just say "pacing" very slowly, like take a couple minutes with it, and walk out.


Posted by: fake accent | Link to this comment | 09- 9-18 9:06 AM
horizontal rule
19

17: You might have to relax the "stay on topic for the first forty minutes" rule.


Posted by: Todd | Link to this comment | 09- 9-18 9:41 AM
horizontal rule
20

Email everyone a joke about reproducibility and cancel it.


Posted by: Mossy Character | Link to this comment | 09- 9-18 9:46 AM
horizontal rule
21

Start every session with a recording of "Beth I hear you calling" to kill time.


Posted by: Moby Hick | Link to this comment | 09- 9-18 11:17 AM
horizontal rule
22

I have a math problem. According to the news, we got four inches of rain over the weekend. But my neighbor didn't bring her trash can in on Saturday morning and it was out in the rain until about a half hour ago when I put it in for her. There was over a foot of water in it. Granted the slides slope a bit inward, but not anything close to 300%. So, did we get that much more rain than the news says or did my neighbor dump water in her trash can? According to my basement, probably we get more rain than the news says the area got, but I don't think it was twelve inches.


Posted by: Moby Hick | Link to this comment | 09- 9-18 3:20 PM
horizontal rule
23

To be 3 times the surface area, it'd have to have sqrt(3) ~= 1.73 times the radius (or diameter), which would be noticeable. I dunno. Strong winds increasing the effective catchment area? There's probably pretty high variability based on location, too--NWS weather report lists 3.07 inches (beating the record of 1.77 set in 1911), but that's probably only over 24 hours (although we didn't have much rain before 5pm yesterday).


Posted by: dalriata | Link to this comment | 09- 9-18 4:18 PM
horizontal rule
24

I got 18 out of 20. I could have gotten 20 out of 20, but I hedged my bets on two of them.


Posted by: peep | Link to this comment | 09- 9-18 4:37 PM
horizontal rule
25

Were the trash cans along a wall or anything that could maybe deflect extra water?


Posted by: Heebie | Link to this comment | 09- 9-18 4:42 PM
horizontal rule
26

Also, I need to tell you all the terrible discussion topic, I think, for full sympathy: civility on a college campus. It's the worst! So boring who cares!


Posted by: Heebie | Link to this comment | 09- 9-18 4:44 PM
horizontal rule
27

I mean, it's fine. It's just that nobody has much interesting stuff to say about it. It just fundamentally does not hold my interest for more than one discussion.


Posted by: Heebie | Link to this comment | 09- 9-18 4:45 PM
horizontal rule
28

25: Not really, but kind of in line with a gutter. About six feet away, but maybe during a downpour, it gets streaming and it goes that far.


Posted by: Moby Hick | Link to this comment | 09- 9-18 5:06 PM
horizontal rule
29

I've shit bigger pieces of civilly onto this campus this week than every committee you've ever been on, combined, since their inceptions.


Posted by: Moby Hick | Link to this comment | 09- 9-18 5:55 PM
horizontal rule
30

Civility is just another way of saying, "People who park like fuckheads will go unpunished."


Posted by: Moby Hick | Link to this comment | 09- 9-18 6:27 PM
horizontal rule
31

27 really illustrate how brilliantly set-up you were. If they won't take a polite expression of disinterest, you either have to do it their way by default or be uncivil, thus demonstrating the need for more talk on civility.


Posted by: Moby Hick | Link to this comment | 09- 9-18 6:41 PM
horizontal rule
32

How did you measure the depth of water in the trashcan? If you just looked at it refraction can be a liar.


Posted by: Mossy Character | Link to this comment | 09- 9-18 7:09 PM
horizontal rule
33

30 is mouseover worthy.


Posted by: dalriata | Link to this comment | 09- 9-18 7:23 PM
horizontal rule
34

27: Maybe you should start with incivility, Texas university edition: https://longreads.com/2018/09/06/having-the-wrong-conversations-about-hate-activity/
Might foment a bit more discussion if you accuse the audience of complicity . . .


Posted by: ydnew | Link to this comment | 09- 9-18 7:28 PM
horizontal rule
35

I did not measure the water with a ruler, but i had to dump the water out. It was way too heavy for four inches of water.


Posted by: Moby Hick | Link to this comment | 09- 9-18 7:29 PM
horizontal rule
36

Did you double-check your unit conversions?


Posted by: Mossy Character | Link to this comment | 09- 9-18 7:33 PM
horizontal rule
37

34: Huh, that author is here in Heebieville.


Posted by: heebie-geebie | Link to this comment | 09- 9-18 7:33 PM
horizontal rule
38

Even four inches deep is plenty heavy: in a 22-inch diameter can that would weigh about 55 pounds.


Posted by: dalriata | Link to this comment | 09- 9-18 7:35 PM
horizontal rule
39

37: Yeah, I thought of you when I read it. It sounded like she maybe resides in Austin and teaches in Heebieville.


Posted by: ydnew | Link to this comment | 09- 9-18 7:42 PM
horizontal rule
40

What's the smallest container that can provide an accurate measure of rain? I've always wondered.


Posted by: ogged | Link to this comment | 09- 9-18 8:00 PM
horizontal rule
41

17: the answer should be clear from your experience here - just allow the discussion to wander gently off topic. Maybe bring some board games along.


Posted by: ajay | Link to this comment | 09-10-18 2:22 AM
horizontal rule
42

What's the smallest container that can provide an accurate measure of rain?

The standard measure has a five-inch-diameter opening one foot above ground level.


Posted by: ajay | Link to this comment | 09-10-18 2:24 AM
horizontal rule
43

And you can buy these?


Posted by: Opinionated Hobbit | Link to this comment | 09-10-18 3:32 AM
horizontal rule
44

42 Inches you say


Posted by: Barry Freed | Link to this comment | 09-10-18 3:41 AM
horizontal rule
45

the answer should be clear from your experience here

After 40 minutes, start telling people who they can't masturbate to.


Posted by: Ginger Yellow | Link to this comment | 09-10-18 3:44 AM
horizontal rule
46

After one session of the series, they and you are allowed to change the subject. Talk about something more interesting, like measuring rainfall.


Posted by: DaveLMA | Link to this comment | 09-10-18 4:50 AM
horizontal rule
47

43: Cheaper for you to just paint the gauge on your wall.


Posted by: Mossy Character | Link to this comment | 09-10-18 4:53 AM
horizontal rule
48

It just keeps fucking raining. If a see a guy with a leek on his hat or a detective with a $700 jacket, I'll have to assume I'm in Wales.


Posted by: Moby Hick | Link to this comment | 09-10-18 5:28 AM
horizontal rule
49

36/42, and on one of those I mistakenly pressed the wrong button. Used the same heuristic as Frowner.


Posted by: One of Many | Link to this comment | 09-10-18 5:46 AM
horizontal rule
50

That'd be interesting as a probability problem: model the rain as a set of N of uniform i.i.d. spherical (hrm, cylindrical is probably easier) events of equal radius r falling vertically over some area A; the gauge is circular of radius R. If the gauge's circle and the cross-section of a raindrop intersects, the gauge takes in water proportional to that intersection. How big does R have to be relative to r to have, with high probability, 2piR^2*water height in the gauge to be comparable (within a few percent) to the height of the entire volume of all N rain drops distributed over A, assuming very large N?

If r and R in close in size, edge effects are going to dominate. If we be perverse and consider R << r, edge effects go away but the distribute of the result is probably a lot more variable. Or maybe not, since we assume a huge N, but our assumptions would start to break down since surface tension would have a big effect.


Posted by: dalriata | Link to this comment | 09-10-18 5:55 AM
horizontal rule
51

Yesterday it rained so hard I couldn't hear audio playing on a laptop I was typing at. Then it kept doing that for two hours.


Posted by: Mossy Character | Link to this comment | 09-10-18 6:02 AM
horizontal rule
52

If we be perverse and consider R

Sounds like the "r"s got the better of you and you've turned pirate.


Posted by: Ginger Yellow | Link to this comment | 09-10-18 6:04 AM
horizontal rule
53

Anyway, the Mon River's flow rate is two orders of magnitude higher than it was last week, and is currently around four times the rate of its previous record on this date (going back eightyish years). It's at 76900 ft^3/s as I type this; the fastest I've ever gone out on it was a swollen spring day when it was around 30k ft^3/s, which was stupidly fast.

Good thing it'll probably end overnight, but that's not going to be enough time to dry out the ground if we get hit by a weakened Florence next weekend.


Posted by: dalriata | Link to this comment | 09-10-18 6:05 AM
horizontal rule
54

I think if Florence falls on you damp ground will cushion the impact.


Posted by: Mossy Character | Link to this comment | 09-10-18 6:08 AM
horizontal rule
55

That hasn't helped Venice.


Posted by: dalriata | Link to this comment | 09-10-18 6:11 AM
horizontal rule
56

Florence only moves westward in the northern hemisphere.


Posted by: Mossy Character | Link to this comment | 09-10-18 6:13 AM
horizontal rule
57

And the umbrella I literally bought yesterday? Broken.


Posted by: Mossy Character | Link to this comment | 09-10-18 6:17 AM
horizontal rule
58

(Not from force of rainfall, just from being crap.)


Posted by: Mossy Character | Link to this comment | 09-10-18 6:18 AM
horizontal rule
59

Florence only moves westward in the northern hemisphere.

Are you calling Florence a ho?


Posted by: Ginger Yellow | Link to this comment | 09-10-18 6:36 AM
horizontal rule
60

Actually she moves westward in the south, too. I was mixing up the clockwise/anticlockwise thing.


Posted by: Mossy Character | Link to this comment | 09-10-18 7:19 AM
horizontal rule
61

Cyclone in the streets, anticyclone in the sheets.


Posted by: ajay | Link to this comment | 09-10-18 7:20 AM
horizontal rule