Isthiscredible.com’s Factual Grades – Validity Analysis

Objective

IsThisCredible can rate the credibility of any news article and the objective of this project was to evaluate the accuracy and validity of those ratings.

Data Collection

News article URLs from various news sources, such as nytimes, npr, and reuters, were collected. The collected URLs were sent as parameters to IsThisCredible’s API endpoint which returns the credibility score of the news article on a scale from 0 to 100.

Data Analysis

Collected scores were analyzed, source-wise and in an aggregated fashion, against the backdrop of binary ratings for news sources: 0 for low-quality sources and 1 for high-quality sources.

Results and Visualizations

News articles from high-quality (low-quality) news sources received high (low) credibility scores from IsThisCredible. Scores averaged for each source reflected a similar pattern.

Distribution of IsThisCredible credibility scores for news articles from low-quality and high-quality sources

IsThisCredible credibility scores for news articles by source name and source quality