Data Visualization Software
Class Outline and Teaching Materials
U. of Edinburgh and Greg's supplementary notes
Theoretical Backgrounds
- Overview: Hans Rosling' talk: long/ short , d3.js , tools
- examples of misleading data viz, MacWorld's iPhone Pie Chart, Cumulative iPhone sales chart
- colors: HSL and HSV, I Want Hue, Viz Palette for Data Visualization Color, sequential, divergent, and qualitative color schemes,
- color blindness => redudant encoding: Accessible Color Experiences, redundant encoding
- geospatial dataviz: kdnuggets, safegraph
Text Processing Tools
- a quick review of regular expressions
- block cut-paste in nano, cut, paste, uniq, ...
- html2csv
- csvkit and textql
- jq / fx / zq
- gpx/kml/geojson conversion
Types of Plots and Diagrams
- pie chart vs stacked bars vs side-by-side bars
- The issue with Pie chart
- line chart / stacked line chart? / gnuplot's filledcurves
- histogram, histogram, [ application in photography] violin chart
- Treemap: when, examples, treemap tool
- More charts for tree data: icicle, sunburst, circlepack
- Marimekko chart for a restaurant + food-cost.csv / Marimekko chart vs Treemap / Simpson’s Paradox: UCB admission + batting + treatment (causality) / juxtaposed "binary" Marimekko charts
- scatter plot, bubble chart
- treevis.net, one zoom tree of life, dogs breeds, simplified, phylogram_d3,
- Chernoff face
- How to Choose the Most Appropriate Chart?
- Visual Cheatsheet
Plotting Tools
- rawgraphs, Greg's notes
- metabase getting started, Greg's notes
- Python Crash Course:
- slice notation: array, string,
- Shallow Copy vs Deep Copy (zh_TW)
- list comprehension: simple examples, fast paced,
- matplotlib gallery, Read a CSV file with Numpy, visual intro to numpy, numpy illustrated, genfromtxt(), scat.py
- gnuplot: HMC, Manning, bubble chart (zh_TW)
- scatplot: satellites and android app sizes
- metabase; grafana
- pipdeptree (zh_TW) / why is pandas so slow? (zh_TW) / ER Diagrams from *.sql files ==> graphviz
- GeoDa
- QGIS
- visualization of high dimensional data: UMAP
Geographic Data and Plotting
- Taiwan's public transportation info (zh_TW)
- OpenStreetMap: History,
- osmand: intro (zh_TW), gpx <==> geojson conversion (zh_TW), importing gpx into osmand (zh_TW),
- overpass turbo and examples, full map feature listing, more examples (zh_TW),
- osm pbf (zh_TW)
- marker cluster map, potluckmap
Conclusions
- Greg's Drawing Toolbox (zh_TW)
Sample data sets
- Our World in Data
- Education Quality from "Our World in Data"
- US census datasets:
poverty by county,
- CIA factbook
- covid19 from EU