User:Econterms/ARTT project

From Wikimedia District of Columbia
< User:Econterms
Revision as of 03:42, 8 May 2022 by Econterms (talk | contribs) (note IPFS standard)
Jump to navigation Jump to search

The ARTT project is to develop a software tool to aid reliability evaluation and discussion. We envision a tool that, when given a URL to a social media page or a Wikimedia page, can give useful information and advice. The tool understands the streucture of what it's looking at, so if it's looking at an English Wikipedia article, it knows there might be a talk page and how to interpret it; knows how to interpret wikilinks knows how to interpret footnotes; knows about ORES scores, and knows about the edit history of this article and how to detect and evaluate the users who have made edits to this article.

We're focused in this round of work on vaccine-related articles, we want to use practical principles which would also work for articles related to politics. We can offer a list of vaccine-related articles.

The tools should be able to detect certain kinds of reliability issues -- e.g. the use of problematic "perennial sources", or certain common claims or relationships (vaccines-autism) which signal links to inaccurate or mis- or dis-information. The tools should be able to give advice on reliability matters and also how to handle discussions about them with other editors (or other users on a social platform).

From April-Aug 2022, we are to help gather information to help design the internals, external appearance, and desirable capabilities of that tool.

Relevant design questions:

  • Is this a relevant signal? "the most recent edit is by an editor who is unreliable, often in conflict, or unknown, e.g. an IP editor?
  • Do we want to mark particular versions of an article as "more reliable" or "less reliable"? In other words, is our reliability evaluation associated with a particular version of an article? I think we should assume yes and not ask a lot in focus groups about it. Let's draw from the lit about ORES and the discussions leading up to ORES.
  • Counts of footnotes and sources?

Sources