Data Visualization
Explore the power of data visualization through a compilation of slides by Daniel Silver from March 2014. Discover techniques, trends, and strategies to transform complex data into meaningful insights. Gain a deeper understanding of visualizing data for effective communication and decision-making. Dive into a visual journey that combines creativity and analysis to present information in a compelling way. Learn how data visualization can unlock the potential of your data and enhance your storytelling capabilities.
Download Presentation

Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Data Visualization Daniel Silver March, 2014 [number of slides courtesy of Stan Matwin]
The KDD Process Interpretation and Evaluation Data Mining Knowledge Selection and Preprocessing p(x)=0.02 Data Patterns & Models Consolidation Data Prepared Data Warehouse Consolidated Data Data Sources
The KDD Process The Architecture of a KDD System Graphical User Interface Interpretation, Visualization and Evaluation Selection and Preprocessing Data Data Mining Consolidation Warehouse Data Sources Knowledge
Data Visualization The greatest value of a picture is when it forces us to notice what we never expected to see J. Tukey Visual analytics can lead to discoveries that neither a computer nor a human could make alone J. Fekete Let your data talk to you J. Stasko Big Data, Saint John, NB 4
What is visualization? Graphical representation of data and relationships within data Why? right (imagery) and left (analytical) brain hemisphere What makes a good visualization? Informative Aesthetically pleasing Often, the right abstraction of the data Big Data, Saint John, NB 5
Windmap http://hint.fm/wind/ [Martin Wattenberg] Captures the Big Picture from the data Data from the National Digital Forecast Database Exhibited in MOMA as graphical art Big Data, Saint John, NB 6
Visualization as a tool for Data exploration Communication of results Big Data, Saint John, NB 7
How best to visualize? Art is good in conveying complex concepts Big Data, Saint John, NB 8
Advertising uses great visualizations Big Data, Saint John, NB 9
But is it that easy art conveys emotions, mental states Visualizing data is different, but still A good visualization should require no explanation Allows us to see the data in a new light Big Data, Saint John, NB 10
Geographic misconceptions The True Size of Africa [Kai Kruse] http://flowingdata.com/2010/10/18/true- size-of-africa/ Big Data, Saint John, NB 11
Conveying Complex Dynamics Projecting on the time axis Using colour, thickness, etc. to combine and overlay data Big Data, Saint John, NB 12
[Minard 1896!] Big Data, Saint John, NB 13
Email mountain [F. Viergas] - making sense of an email archive Big Data, Saint John, NB 14
Visual exploration process [Yau, Data Points, 2013] Big Data, Saint John, NB 15
Exploring data ACOA database of 28,000 projects Contains Client s address, postal code Amount of funding Project description Program type . Big Data, Saint John, NB 16
ACOA data Project Number Client Name Client Address Client City Client Postal Code Project Description Project Location Project Geographic Code Program Type Business Development Program Assistance Type ACOA Assistance Non-Repayable Contribution 197595(ISIS) Immigrant Settlement and Integration Services Society Halifax, B3L 4P1 Halifax B3L 4P1 IBDS funding for 2010 - 2011 HALIFAX 1209034 149,832.00 Immigrant entrepreneur and business succession integration ATLANTIC REGION BDP - Atlantic Population Strategy Non-Repayable Contribution 198632(ISIS) Immigrant Settlement and Integration Services Society Halifax, B3L 4P1 Halifax B3L 4P1 1400000 14,040.00 The Immigrant Women Entrepreneurial Project (IWEP) ATLANTIC REGION BDP - Atlantic Population Strategy Non-Repayable Contribution Non-Repayable Contribution 200029(ISIS) Immigrant Settlement and Integration Services Society Halifax, B3L 4P1 Halifax St. John's, A1B 2Z2 Marystown, A0K 2M0 Marystown, A0K 2M0 B3L 4P1 1400000 79,607.00 157116* Quidi Vidi Rennies River Development Foundation St. John's A1B 2Z2 Environmental Education Expansion ST. JOHN'S 1001519Partnerships ACOA - Action Program (AAP) 35,000.00 154136* Burin Peninsula Community Business Development Corporation Inc. Marystown A0K 2M0 implement a youth business program MARYSTOWN 1002024 Grant Non-Repayable Contribution Unconditionally Repayable Contribution 6,800.00 154135* Burin Peninsula Community Business Development Corporation Inc. Marystown A0K 2M0 Youth Internship Program - Phase 3 MARYSTOWN 1002024Community Futures 15,001.00 Petit Rocher Nord, E8J 2K7 To acquire equipment & make changes to the ventilation,water ACOA - Action Program (AAP) AIP - ISDI - SME Technology Advancement Business Development Program Business Development Program Business Development Program Business Development Program 113504042691 N. B. Lt e Petit Rocher Nord E8J 2K7 PETIT-ROCHER 1315014 9,520.00 Bouctouche, E4S 2J2 Non-Repayable Contribution Unconditionally Repayable Contribution Unconditionally Repayable Contribution Unconditionally Repayable Contribution Unconditionally Repayable Contribution Non-Repayable Contribution Non-Repayable Contribution 185785047100 N.B. Inc. Bouctouche E4S 2J2 Lean Analysis BOUCTOUCHE 1308005 22,413.00 Mundleville, E4W 2N5 Building expansion and purchase of equipment for winery 203111051996 N.B. Ltd. Mundleville E4W 2N5 RICHIBUCTO 1308018 74,618.00 Tracadie-Sheila, E1X 1G6 Expansion - pool, washrooms, electrical, road upgrades.... 167460052412 N-B Lt e Tracadie-Sheila E1X 1G6 SAUMAREZ 1315001 18,400.00 Tracadie-Sheila, E1X 1G6 Chalet/Campground expansion - adding activities 167466052412 N-B Lt e Tracadie-Sheila E1X 1G6 SAUMAREZ 1315001 210,000.00 St-Quentin, E8A 2H9 Beresford, E0B 1H0 Bathurst, E2A 4Z2 183896053247 N.B. Lt e St-Quentin E8A 2H9 Construction of potato storage SAINT-QUENTIN 1314022 183,390.00 168364054000 NB Inc. Beresford E0B 1H0 Purchase 2 blueberry harvestors BERESFORD 1315015Agriculture ACOA - Action Program (AAP) 182 169969056393 N.B. Ltd. Bathurst E2A 4Z2 Estab. of Beach Cleaning Service BATHURST 1315011 38,729.00 Big Data, Saint John, NB 17
Geo mapping We map the Postal code of each ACOA project to geographic coordinates using the PCCF Canada Post database Big Data, Saint John, NB 18
ACOA Data [Tableau] Big Data, Saint John, NB 19
ACOA Program Types Business Development Program Productivity and Business Skills (PBS) ACOA Action Program (AAP) Other Big Data, Saint John, NB 20
ACOA data geolocated by project type Big Data, Saint John, NB 21
Visualization and text Wordcloud with R Big Data, Saint John, NB 22
Beyond wordcloud How to characterize at a high level what the project is all about? Find, by analyzing all project descriptions, high level clusters ( topics ) of descriptions can be identified Big Data, Saint John, NB 23
5 LDA topics for ACOA projects Topic 1 Topic 2 Topic 3 Topic 4 Topic 5 conference equipment equipment activities program development development activities existing development existing plan plan equipment business facility facility business new system equipment business host host new system expansion centre development equipment plan operation expansion training market study new new operation study activities activities market business tourism project centre project support international event equipment-add equipment-new training-support study+tourism Big Data, Saint John, NB 24
So where is the future? - challenges Visualization of stream/dynamic data (animation?) Visualization of very large graphs Visualization of multi-dimensional data (see OECD life quality demo) Visualization for mobile devices (limited screen sizes, limited power) Evaluation of visualization Big Data, Saint John, NB 25