|
@JoelChan86 | |||||
|
Provocative question! This q is quite similar to what we grapple with in #creativity research. Agree there is no simple metric, need to triangulate. NSF-sponsored creativity support tools workshop (led in part by @benbendc) had this as a major conclusion: cs.umd.edu/hcil/CST/Paper… pic.twitter.com/Qng9pt36Kf
|
||||||
|
||||||
|
Andy Matuschak
@andy_matuschak
|
17. sij |
|
How should we evaluate tools for thought? There's no simple metric, as far as I can tell. The best tools change your paradigm anyway, so your old metrics (books printed per year?) aren't what matter.
Here's one (vague, but focusing): how much meaning is unlocked on the margin?
|
||
|
|
||
|
Joel Chan, owning it while I'm honing it
@JoelChan86
|
30. sij |
|
For me, one focusing point is the extent to which the conceptual space expands. So we should look for qualitative rather than quantitative shifts (or if quant, looking for changes in the function, not just slope).
|
||
|
|
||
|
Joel Chan, owning it while I'm honing it
@JoelChan86
|
30. sij |
|
One nice example of this sort of qualitative shift measure is this work by @pierre_azoulay: rate at which new standardized keywords are added to a field: onlinelibrary.wiley.com/doi/full/10.11… pic.twitter.com/ORH5JYV2Bv
|
||
|
|
||
|
Joel Chan, owning it while I'm honing it
@JoelChan86
|
30. sij |
|
Folks in visual analytics also grapple with this: they want to create tools that increase p(insight), but that is hard to conceptualize and measure: ieeexplore.ieee.org/abstract/docum… - they come to a similar conclusion pic.twitter.com/P2L4HE9MuF
|
||
|
|
||