Discussion about this post

User's avatar
Dr Efevretis's avatar

Good issue, and the FDA section is the most useful summary of that discussion paper I've seen.

Your point about the disclaimer is the sharpest thing here. That "talk to your doctor" underneath specific advice probably doesn't buy an app the informational classification, because what counts is what the output tells the person to do. What's interesting is that three separate items in this issue are making the same argument from different directions. The FDA says you can't pre-specify every correct output, so you evaluate against a clinician panel and keep monitoring. The Cell piece says current benchmarks test retrospective statistical tasks rather than decisions. The Nature Reviews Neurology perspective says deployment is another stage of evaluation rather than the end of one.

All three are moving evaluation from output-referenced to decision-referenced. Which is exactly why the disclaimer fails: if the unit of assessment is the decision the output produces, a sentence appended after it can't reclassify anything.

3 more comments...

No posts

Ready for more?