DMI Tools

Provides different analytics for Amazon.com's book search

This PHP script allows you to enter a (set of) ASIN(s) and crawl its recommendations up til a user-specified depth.

Input tags and values to produce relatively sized bubbles. Output is an svg.

Check whether a URL is censored in a particular country by using proxies located around the world.

Generate and refine palettes of optimally distinct colors. (by Médialab Sciences-Po)

Compare two lists of URLs for their commonalities and differences.

Compares Issue Crawler networks over time, and displays ranked actor lists. The over time module is best used in tandem with the Issue Crawler scheduler. The results may be plotted to line g...

Convert an Issuecrawler XML file into the WXSF format of the Navicrawler file. For Navicrawler, see http://webatlas.fr/wp/navicrawler/.

Replicates the tags in a tag cloud by their value

This tool scrapes threads and comments from websites implementing the Disqus commenting system.

Input tags and values to produce a Dorling Map (i.e. bubbles). Output is an svg.

Expands URLs that have been shortened by tools like tinyurl.com or bit.ly. Often used in social media such as Twitter or Facebook.

Extracts URLs from an Issuecrawler result file (.xml). Useful for retrieving starting points as well as a clean list of the actors in the network.

Extracts geographic locations from text.

Translates URLs or IP addresses into geographical locations

Extract the meta-data of organizations on Github

Extract the meta-data of Github repositories

Scrape Github for forks of projects

Scrape Github for user interactions and user to repository relations

Retrieves autocomplete suggestions from Google

Query images.google.com with one or more keywords, and/or use images.google.com to query specific sites for images.

Scrapes Google News.

Scrape Google for occurance of images

Batch queries Google. Query the resonance of a particular term, or a series of terms, in a set of Websites.

Extract URLs from text, source code or search engine results. Produces a clean list of URLs.

Scrape images from a single page.

Gets the follow or follower network from a set of Instagram users.

Retrieves Instagram images for hashtags, locations, or user names.

Scrapes links from the Wayback Machine

Enter a set of URLs and the archived versions closest to 1 July for a specific year are retrieved. Thereafter links are extracted and a network file is output.

Enter URLs, and discover the most relevant words and phrases contained in them. One also may enter text, or an Issuecrawler result file (.xml). Based on Yahoo Term Extraction

Enter up to 3 URLs as well as a key word. The Issuedramaturg queries Google for the key word, and shows the Pageranks of the URLs over time. The output is a graph of the Pagerank of the URLs...

Geo-locates the organizations on an Issue Crawler map, using whois information, and visualizes the organizations' registered locations on a geographical map.

Enter URLs and the Issue Crawler performs co-link analysis in one, two or three iterations, and outputs a cluster graph. The Issue Crawler also has modules for snowball crawling (up to 3 deg...

Queries the itunes store

Detects language for given URLs. The first 1000 characters on the Web page(s) are extracted, and the language of each page is detected.

Retrieves the number of likes on Facebook for a series of URLs

Capture all internal links and/or outlinks from a page.

The Lippmannian device is named after Walter Lippmann, and provides a coarse means of showing actor partisanship.

This tool allows one to visualize the output of the Lippmannian device as a network with Gephi.

Extracts various datasets from Facebook.

Discovers the most relevant words and phrases among a set of websites, within a text, or within an issue network. Based on Reuters Open Calais.

Enter an Issuecrawler XML file and this script will get out all pages from the core network and rank those by pages by inlink count.

Takes raw text, counts the words and returns an ordered, unordered or alphabetically ordered tagcloud.

Rip text from a specified page and force line breaks between sentences.

Display a site's robot exclusion policy.

loads a URL and searches for patterns in the page's source code

Enter URLS, and count the top level domains.

Extract a network from a table. Set a column for nodes and a column for edges. It deals with multiple items per cell. (by Médialab Sciences-Po)

Enter two or more tag clouds and the values of each tag will be summed.

Input tags and values to produce a tag cloud. Output is in SVG.

Input tags and values in wordle format to produce a HTML tag cloud or tag list.

This tool allows one to transform a normal tag cloud into a fancy Wordle one.

Rip all non-html (i.e. text) from a specified page.

Rips and displays a web page's last modification date (using the page's HTML header). Beware of dynamically generated pages, where the date stamps will be the time of retrieval.

The tool Tracker Tracker uses Ghostery to detect in a set of URLs a predefined set of 'fingerprints' of web technologies, such as social buttons and trackers, and outputs a list of technolog...

Enter two or more lists of URLs or other items to discover commonalities among them. Possible visualizations include a Venn Diagram.

a simple co-hashtag and post data tool for Tumblr

Captures tweets and allows for multiple analyses (hashtags, mentions, users, search, ...)

Makes the images of all language versions of a Wikipedia article comparable.

Scrapes Wikipedia history and does IP to Geo for anonymous edits

This tool checks if the issues exist as a Wikipedia page, i.e., an article. If it exists it checks whether the organization is mentioned on that page.

This script allows you to specify a range of Wikipedia revisions for use with the History Flow visualization.

Scrape Table of Contents for revisions of a wikipedia page and explore the results by moving a slider to browse across chronologically ordered TOCs.

A collection of simple tools for extracting data from the You Tube platform via the You Tube API v3.