4.1 Insights from large datasets

NCA-GENL · Data Analysis and Visualization (14% of the exam) · Official objective: “Awareness of the process of extracting insights from large datasets using data mining, data visualization, and similar techniques.”

Interactive, GPU-accelerated exploration.

Key points

  1. Visualization helps the brain take in large amounts of information quickly. NVIDIA notes interactions slower than 7-10 seconds disrupt the user's short-term memory. Graphics processing unit (GPU) libraries bring compute and render times down to interactive speeds.

    What NVIDIA says (3)

    “However, interactions such as filtering, selecting, or rerendering points that are slower than 7-10 seconds result in a disruption of a user”

    — Accelerated Data Analytics: A Guide to Data Visualization with RAPIDS

    “This style of visualization is essentially a hack for the brain to understand large amounts of information quickly.”

    — Accelerated Data Analytics: A Guide to Data Visualization with RAPIDS

    “Visualization compute and render times are brought down to interactive speeds”

    — Accelerated Data Analytics: A Guide to Data Visualization with RAPIDS

  2. NVIDIA's guide says that when an exploratory data analysis (EDA) workflow processes more than 2 gigabytes (GB) with compute-intensive tasks, central processing unit (CPU)-based tools can slow iteration. Switching to pandas-like RAPIDS graphics processing unit (GPU) libraries such as cuDF keeps the pace up.

    What NVIDIA says (2)

    “But when an EDA workflow is processing data larger than 2 GB, and requires compute intensive tasks, CPU-based solutions can start to constrain the iterative exploration process.”

    — Accelerated Data Analytics: A Guide to Data Visualization with RAPIDS

    “Replacing CPU-based libraries with the pandas-like RAPIDS GPU-accelerated libraries (such as cuDF) means you can keep a swift pace for your EDA process”

    — Accelerated Data Analytics: A Guide to Data Visualization with RAPIDS

  3. cuDF is a pandas-like RAPIDS graphics processing unit (GPU)-accelerated library. NVIDIA says it gives GPU acceleration through a familiar pandas-like application programming interface (API).

    What NVIDIA says (2)

    “enables GPU acceleration that unlocks access to your data insights through a familiar pandas-like API.”

    — Accelerated Data Analytics: A Guide to Data Visualization with RAPIDS

    “the pandas-like RAPIDS GPU-accelerated libraries (such as cuDF)”

    — Accelerated Data Analytics: A Guide to Data Visualization with RAPIDS

Key terms

Sample question

NVIDIA's RAPIDS visualization guide warns about interactions that are too slow. What happens when filtering or re-rendering takes longer than about 7-10 seconds?

Show the answer

Answer: It disrupts the user's short-term memory and train of thought, which hurts exploration

Visualization helps the brain take in large amounts of information quickly. NVIDIA notes interactions slower than 7-10 seconds disrupt the user's short-term memory. Graphics processing unit (GPU) libraries bring compute and render times down to interactive speeds.

What NVIDIA says (3)

“However, interactions such as filtering, selecting, or rerendering points that are slower than 7-10 seconds result in a disruption of a user”

— Accelerated Data Analytics: A Guide to Data Visualization with RAPIDS

“This style of visualization is essentially a hack for the brain to understand large amounts of information quickly.”

— Accelerated Data Analytics: A Guide to Data Visualization with RAPIDS

“Visualization compute and render times are brought down to interactive speeds”

— Accelerated Data Analytics: A Guide to Data Visualization with RAPIDS

Practice 4.1 (3 questions) Full Data Analysis and Visualization guide

← 3.7 Running experiments on models and pipelines · 4.2 Comparing models with statistics →